-- Logs begin at Tue 2022-07-19 14:49:41 UTC, end at Tue 2022-07-19 16:15:58 UTC. -- Jul 19 15:21:21.446464 dv-cinder-849846-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 15:21:21.456670 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:21:21 2022] *** Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: nodename: dv-cinder-849846-2-iscsi Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: machine: x86_64 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: clock source: unix Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: pcre jit disabled Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: detected number of CPU cores: 4 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: current working directory: / Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: your processes number limit is 47680 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: your memory page size is 4096 bytes Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: detected max file descriptor number: 2048 Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: lock engine: pthread robust mutexes Jul 19 15:21:21.457436 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: thunder lock: enabled Jul 19 15:21:21.458613 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 15:21:21.458613 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:21:21.501195 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: Python main interpreter initialized at 0x561ceabfb9c0 Jul 19 15:21:21.501195 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: python threads support enabled Jul 19 15:21:21.501195 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: your server socket listen backlog is limited to 100 connections Jul 19 15:21:21.501195 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:21:21.501571 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:21:21.501656 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: *** Operational MODE: preforking *** Jul 19 15:21:21.501891 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:21:21.501891 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: spawned uWSGI master process (pid: 103273) Jul 19 15:21:21.502030 dv-cinder-849846-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 15:21:21.503695 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: spawned uWSGI worker 1 (pid: 103274, cores: 1) Jul 19 15:21:21.503695 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: spawned uWSGI worker 2 (pid: 103275, cores: 1) Jul 19 15:21:21.504010 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:21:22.159130 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:21:22.165292 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:21:23.277616 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:21:23.277616 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: from cryptography.utils import int_from_bytes Jul 19 15:21:23.278203 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:21:23.278203 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: from cryptography.utils import int_from_bytes Jul 19 15:21:23.281829 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:21:23.281829 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: from cryptography.utils import int_from_bytes Jul 19 15:21:23.282285 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:21:23.282285 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: from cryptography.utils import int_from_bytes Jul 19 15:21:25.804218 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:21:25.804864 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:21:25.804955 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:21:25.804955 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:21:25.805397 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:21:25.805484 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:21:25.805558 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:21:25.805637 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:21:25.805703 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:21:25.805893 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:21:25.805998 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806228 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806316 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806551 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806654 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806866 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.806965 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807179 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807265 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807481 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807568 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807794 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.807891 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808107 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808205 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808420 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808506 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808674 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808759 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.808982 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809068 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809314 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809401 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-2-iscsi {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809632 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809736 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-2-iscsi {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.809933 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810029 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810236 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810322 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810547 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810634 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810841 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.810946 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811151 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811236 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811448 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811533 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811759 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.811941 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812334 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812520 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812636 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812748 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812869 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.812981 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813154 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813307 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813492 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813804 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.813944 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.814110 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.814197 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.814425 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.814520 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.814832 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815201 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815283 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815501 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815618 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-2-iscsi {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815824 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.815940 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-2-iscsi {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816134 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816244 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816439 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816532 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816761 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.816917 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817153 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817256 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817463 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817606 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817776 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.817862 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818091 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818183 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818400 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818495 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818702 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.818787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819022 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819115 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819336 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819429 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819665 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819804 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.819947 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820033 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820245 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820331 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820546 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820632 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820851 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.820959 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821165 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821265 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821469 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821566 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821717 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.821833 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822001 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822089 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822305 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822391 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822622 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822718 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.822937 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823027 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823185 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823279 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823430 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823518 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823721 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.823806 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824037 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824131 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824341 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824428 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824642 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824735 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.824946 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825057 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825268 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825356 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825570 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825657 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825870 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.825970 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826172 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826259 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826473 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826565 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826776 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.826876 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827083 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827169 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827391 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827475 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827692 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827786 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.827999 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828085 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828316 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828402 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828628 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828722 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.828933 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829018 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829256 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829345 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829592 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829679 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829895 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.829980 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.830741 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.830835 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831073 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831159 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831394 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831487 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831701 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.831797 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832004 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832100 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832309 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832395 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832711 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.832924 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833055 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833203 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833287 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833482 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833580 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833784 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.833871 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834085 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834170 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834385 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834479 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834687 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834773 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.834991 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835107 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835296 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835406 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835592 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835685 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835894 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.835985 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836196 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836297 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836500 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836591 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836801 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.836891 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837118 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837239 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837424 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837515 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837722 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.837813 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838021 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838111 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838320 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838411 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838633 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838724 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.838934 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839024 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839235 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839334 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839535 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839836 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.839959 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840137 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840236 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840437 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840527 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840736 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.840827 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841057 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841168 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841368 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841459 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841670 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841761 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.841969 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842060 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842271 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842368 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842572 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842664 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842873 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.842962 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843165 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843256 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843466 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843565 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843767 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.843866 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844067 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844160 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844365 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844456 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844660 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844753 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.844957 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.845057 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.845275 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.845366 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.845574 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.845664 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.846535 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.846648 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.846842 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.846934 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847146 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847238 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847444 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847544 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847759 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.847851 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848078 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848176 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848384 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848484 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848687 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848778 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.848988 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.849080 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.849327 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:21:25.849420 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.849658 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.849748 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.849986 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850077 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850297 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850387 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850624 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850714 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.850948 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851045 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851262 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851353 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851569 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851660 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.851876 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852045 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852187 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852274 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852486 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852576 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852792 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.852891 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853098 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853215 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853428 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853518 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853737 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.853837 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854048 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854155 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854357 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854448 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854669 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854770 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.854979 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855069 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855281 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855371 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855587 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855687 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855902 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.855994 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856213 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856303 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856518 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856619 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856822 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.856913 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857172 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857265 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857500 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857604 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857813 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.857903 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858128 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858218 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858436 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858527 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858743 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.858833 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859047 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859137 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859353 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859442 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859670 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859762 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.859975 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860073 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860290 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860382 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860598 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860689 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.860906 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861011 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861233 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861326 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861569 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861659 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861874 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.861975 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862180 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862271 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862503 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862657 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862795 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.862940 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863109 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863251 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863419 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863571 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863716 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.863860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864021 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864164 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864330 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864472 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864614 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864757 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.864916 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865067 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865267 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865407 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865565 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865712 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865850 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.865986 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866130 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866266 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866421 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866558 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866718 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.866870 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867008 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867145 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867334 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867487 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867624 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867768 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.867933 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868077 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868229 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868378 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868516 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868651 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868828 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.868979 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869116 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869287 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869434 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869571 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869741 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.869896 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870048 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870185 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870323 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870458 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870644 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870798 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.870936 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871071 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871217 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871353 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871527 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871687 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871826 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.871961 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872128 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872273 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872419 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872555 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872728 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.872872 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873037 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873231 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873392 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873530 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873667 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873802 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.873975 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874117 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874337 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874477 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874614 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874749 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.874884 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875020 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875174 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875312 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875487 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875631 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875777 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.875922 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876060 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876203 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876362 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876513 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876652 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876797 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.876967 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877112 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877286 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877424 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877583 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877747 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.877893 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878033 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878170 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878313 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878458 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878604 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878749 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.878895 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879032 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879167 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879312 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879448 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879614 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879767 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.879910 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880047 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880196 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880333 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880535 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880664 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880823 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.880918 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881175 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881267 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881509 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881666 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881811 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.881954 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882109 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882254 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882418 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882582 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882727 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.882891 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883042 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883193 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883337 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883479 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883621 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883772 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.883918 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884061 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884204 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884353 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884504 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884656 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.884963 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885106 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885295 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885449 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885602 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885756 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.885900 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886045 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886187 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886331 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886482 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886779 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.886923 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887067 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887219 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887370 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887514 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887666 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887810 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.887953 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888106 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888250 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888406 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888564 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888707 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.888850 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889006 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889179 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889330 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889474 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889639 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889785 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.889937 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890081 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890225 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890377 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890531 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890683 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890827 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.890970 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.891112 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.891256 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.891400 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.891556 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.891965 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.892109 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.892252 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.892404 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.892548 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.893270 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.893420 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.893596 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.893795 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.893943 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894086 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894240 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894400 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894544 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894687 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894830 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.894982 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895127 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895282 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895429 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895580 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895724 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.895876 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896028 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896172 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896323 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896468 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896611 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896767 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.896912 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897065 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897246 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897395 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897539 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897691 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897835 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.897990 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898135 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898293 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898450 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898595 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898738 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.898881 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899041 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899186 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899338 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899489 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899634 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899776 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.899919 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900061 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900216 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900360 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900503 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900647 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900798 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.900957 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901109 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901440 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901594 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901739 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.901881 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902036 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902180 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902322 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902465 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902608 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902830 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.902988 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903131 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903274 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903417 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903559 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903711 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.903863 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904007 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904149 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904292 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904442 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904595 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904739 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.904900 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905070 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905260 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905407 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905559 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905703 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905846 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.905988 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906130 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906281 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906432 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906576 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906731 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.906875 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907134 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907294 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907439 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907583 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907739 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.907884 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.908038 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.908246 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.908932 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.909114 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.909452 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.909612 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.909757 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.909914 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910059 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910203 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910345 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910487 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910487 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910770 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.910770 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911042 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911186 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911328 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911490 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911643 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911793 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.911938 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912080 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912225 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912376 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912527 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912677 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912820 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.912963 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913118 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913357 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913515 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913669 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913825 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.913977 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914122 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914264 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914408 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914560 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914704 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914846 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.914989 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915132 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915438 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915597 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915743 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.915886 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916028 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916170 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916322 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916467 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916610 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916759 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.916909 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917061 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917248 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917405 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917559 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917703 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917846 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.917997 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918142 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918296 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918447 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918592 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918734 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.918885 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919037 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919190 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919334 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919476 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919620 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919771 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.919923 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920066 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920208 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920351 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920503 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920791 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.920944 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921088 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921290 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921451 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921597 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921740 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.921883 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922025 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922174 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922326 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922470 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922613 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922762 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.922916 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923067 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923212 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923354 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923496 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923650 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923823 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.923990 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924136 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924278 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924421 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924563 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924705 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.924867 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925051 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925217 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925367 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925510 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925654 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925809 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.925955 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926098 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926240 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926382 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926603 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926758 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.926914 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927057 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927200 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927342 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927494 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927644 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927789 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.927932 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928083 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928244 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928402 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928546 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928706 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928850 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.928994 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929188 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929353 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929505 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929649 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929791 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.929934 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930086 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930231 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930373 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930515 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930812 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.930973 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931126 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931269 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931412 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931554 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931697 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931852 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.931997 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932140 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932283 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932425 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932589 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932743 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.932886 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933028 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933260 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933409 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933553 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933712 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.933864 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934008 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934151 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934294 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934446 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934600 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934743 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.934886 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935028 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935171 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935324 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935475 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935619 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935761 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.935910 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936053 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936205 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936357 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936510 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936653 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936653 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.936942 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937086 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937273 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937430 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937575 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937718 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.937870 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938022 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938176 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938330 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938475 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938778 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.938922 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939065 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939208 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939351 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939679 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939839 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.939985 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940128 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940279 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940434 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940589 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940734 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.940885 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941029 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941194 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941355 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941508 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941662 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941806 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.941949 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942097 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942248 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942415 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942561 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942705 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942847 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.942990 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943133 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943428 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943570 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943715 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.943857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944000 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944152 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944306 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944450 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944599 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944763 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.944992 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945188 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945341 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945485 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945771 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.945931 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946076 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946219 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946372 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946516 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946659 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946811 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.946956 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947107 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947263 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947416 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947559 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947711 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947855 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.947999 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948160 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948307 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948460 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948612 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948756 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.948899 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949058 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949228 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949386 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949539 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949683 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949826 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.949969 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950123 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950280 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950425 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950575 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950719 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.950861 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951004 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951156 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951300 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951443 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951586 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951729 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.951880 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952041 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952195 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952339 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952482 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952632 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952785 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.952937 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953080 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953430 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953573 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953725 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.953869 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954021 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954166 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954310 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954453 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954671 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954824 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.954968 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.955675 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.955830 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.955983 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956135 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956279 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956436 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956586 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956738 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.956890 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957034 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957207 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957358 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957501 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957655 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957809 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.957960 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958113 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958256 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958410 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958569 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958730 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.958875 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959025 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959170 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959320 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959473 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959617 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959760 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.959903 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960045 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960196 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960362 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960508 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960651 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960801 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.960971 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961300 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961446 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961590 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961740 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.961884 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962026 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962188 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962333 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962475 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962639 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962792 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.962936 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963079 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963229 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963386 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963530 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963674 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963818 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.963960 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964113 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964265 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964410 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964552 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964696 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.964838 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965057 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965248 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965407 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965553 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965705 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.965855 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966012 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966168 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966312 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966456 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966607 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966760 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.966914 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967059 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967202 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967358 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967503 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967655 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967800 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.967960 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968105 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968254 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968399 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968558 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968714 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.968859 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969003 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969175 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969336 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969494 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969639 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969790 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.969946 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970090 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970239 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970392 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970543 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970762 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.970927 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971081 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971240 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971395 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971547 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971692 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.971844 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972001 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972001 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972555 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972697 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972840 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.972840 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973122 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973122 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973463 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973463 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973742 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.973905 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974062 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974208 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974351 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974494 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974645 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974645 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974918 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.974918 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975200 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975345 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975497 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975497 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975779 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.975923 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976066 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976066 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976348 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976500 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976644 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.976929 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977081 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977266 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977413 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977645 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977804 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.977949 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978102 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978248 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978405 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978557 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978711 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.978862 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979160 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979303 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979447 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979601 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979744 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.979897 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980041 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980185 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980329 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980479 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980684 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980842 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.980987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981189 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981343 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981489 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981662 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981808 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.981952 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982095 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982245 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982390 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982543 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982696 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982840 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.982984 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983127 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983271 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983432 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983578 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983733 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.983879 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984021 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984165 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984317 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984462 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984606 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984749 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.984892 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985043 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985209 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985369 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985525 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985671 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985814 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.985966 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.986110 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.986254 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.986931 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987091 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987243 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987396 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987541 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987691 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987846 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.987997 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988150 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988305 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988450 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988450 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988733 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.988884 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989037 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989227 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989379 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989523 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989667 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989822 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.989978 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990124 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990268 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990411 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990562 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990706 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.990860 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991004 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991148 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991299 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991451 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991606 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991760 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.991906 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992056 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992200 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992351 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992505 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992657 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992809 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.992954 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993148 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993301 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993537 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993686 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993830 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.993974 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994276 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994421 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994572 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994717 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.994860 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995003 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995156 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995312 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995456 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995603 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995750 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.995941 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996092 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996245 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996391 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996535 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996686 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996841 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.996986 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997163 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997315 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997459 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997603 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997764 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.997911 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998055 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998198 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998342 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998500 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998655 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998799 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.998955 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999099 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999243 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999395 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999540 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999684 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999834 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:25.999979 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000123 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000276 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000428 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000573 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000726 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.000877 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001031 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001221 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001372 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001516 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001670 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.001821 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002154 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002313 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002467 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002612 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002755 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.002909 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003063 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003208 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003352 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003495 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003638 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003781 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.003937 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004089 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004233 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004377 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004521 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004673 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004830 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.004981 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005126 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005308 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005464 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005619 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005763 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.005906 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006048 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006192 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006346 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006504 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006657 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006814 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.006965 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007109 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007260 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007415 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007561 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007706 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.007855 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008000 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008152 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008297 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008440 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008600 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008748 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.008891 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009046 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009227 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009389 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009535 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009679 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009831 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.009984 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010129 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010273 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010416 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010569 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010720 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.010874 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011019 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011163 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011307 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011464 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011618 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011764 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.011915 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012059 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012202 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012345 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012507 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012652 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012796 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.012939 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013083 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013275 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013466 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013617 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013761 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.013912 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014065 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014208 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014370 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014515 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014659 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014802 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.014946 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015099 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015251 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015401 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015552 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015696 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015839 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.015992 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.016138 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.016291 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.016434 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.016577 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.016986 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.017161 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.017325 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.017477 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018163 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018311 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018455 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018612 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018766 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.018910 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019073 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019234 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019389 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019534 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019678 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019821 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.019964 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020106 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020258 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020402 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020552 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020696 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020838 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.020992 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021198 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021352 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021497 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021783 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.021927 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022153 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022302 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022446 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022596 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022741 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.022898 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023053 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023197 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023340 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023484 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023626 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023778 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.023922 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024064 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024208 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024351 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024496 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024803 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.024978 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025131 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025318 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025479 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025624 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025768 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.025918 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026069 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026213 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026366 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026511 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026664 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026817 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.026962 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027106 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027260 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027405 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027549 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027700 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027844 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.027988 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028140 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028285 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028437 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028599 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028746 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.028899 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029054 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029250 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029397 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029541 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029702 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.029857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030003 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030003 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030291 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030448 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030600 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030755 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.030900 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031043 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031186 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031329 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031484 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031629 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031775 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.031917 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032060 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032204 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032364 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032364 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032638 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032638 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.032911 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033054 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033276 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033430 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033574 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033718 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.033862 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034015 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034170 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034322 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034468 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034611 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034755 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.034908 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035060 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035211 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035355 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035498 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035641 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035794 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.035957 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036102 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036258 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036404 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036561 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036706 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036849 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.036993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037182 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037334 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037489 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037636 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037787 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.037949 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038095 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038238 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038389 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038534 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038677 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038829 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.038981 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039137 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039294 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039439 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039582 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039732 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.039886 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040040 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040186 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040330 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040474 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040617 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040767 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.040920 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041065 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041245 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041393 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041537 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041680 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041842 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.041987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042131 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042282 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042426 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042568 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042725 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.042869 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043012 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043155 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043298 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043450 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043612 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043756 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.043900 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044043 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044200 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044354 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044505 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044649 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044793 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.044936 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045098 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045308 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045456 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045609 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045753 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.045896 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046052 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046205 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046357 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046502 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046645 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046794 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.046947 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047098 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047295 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047446 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047602 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047746 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.047899 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.048052 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.048206 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.048350 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.048502 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.048647 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.049331 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.049485 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.049632 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.049776 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.049940 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050160 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050315 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050459 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050604 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050757 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.050903 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051056 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051202 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051353 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051498 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051641 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051792 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.051956 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052102 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052246 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052397 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052542 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052698 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052845 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.052996 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.053193 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.053347 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.053501 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.053693 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.053854 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054006 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054150 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054337 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054490 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054644 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054797 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.054950 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055094 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055238 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055395 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055540 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055698 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055841 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.055985 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056127 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056313 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056463 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056607 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056765 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.056911 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057055 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057235 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057383 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057526 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057687 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057832 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.057985 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058138 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058283 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058426 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058569 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058712 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.058864 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059009 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059152 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059301 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059458 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059602 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059754 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.059754 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:21:26.060029 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.060029 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:21:26.060029 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:21:26.123129 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Registered counter for database nova_api Jul 19 15:21:26.123379 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Registered counter for database nova_api Jul 19 15:21:26.236266 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.238899 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.243836 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.245417 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.299919 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.context [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38(cell1) {{(pid=103275) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:21:26.301600 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.context [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38(cell1) {{(pid=103274) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:21:26.303655 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:21:26.305266 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:21:26.305509 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:21:26.306024 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:21:26.307077 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:21:26.307865 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:21:26.308108 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:21:26.310006 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_concurrency.lockutils [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:21:26.310106 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Registered counter for database nova_cell0 Jul 19 15:21:26.311942 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Registered counter for database nova_cell0 Jul 19 15:21:26.313849 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Registered counter for database nova_cell1 Jul 19 15:21:26.316083 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Registered counter for database nova_cell1 Jul 19 15:21:26.321254 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.323592 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.327329 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.328901 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.329016 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.335076 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.337701 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.465405 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.476262 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Registered counter for database nova_cell0 Jul 19 15:21:26.482901 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO dbcounter [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Registered counter for database nova_cell0 Jul 19 15:21:26.485197 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.489605 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.491612 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG oslo_db.sqlalchemy.engines [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:21:26.496305 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writer thread running {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:21:26.823429 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:21:26.825823 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:21:26.831353 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:21:26.833812 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:21:27.173434 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:21:27.177088 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:21:27.180140 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: WARNING keystonemiddleware.auth_token [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:21:27.182986 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:21:27.185394 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ceabfb9c0 pid: 103274 (default app) Jul 19 15:21:27.187457 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:21:27.188151 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561ceabfb9c0 pid: 103275 (default app) Jul 19 15:21:27.188660 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-a159efe3-a122-4d2d-ad00-90c11994d3bc None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jul 19 15:21:27.189073 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Tue Jul 19 15:21:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:43.859952 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:43.861265 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Jul 19 15:22:43.861662 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:22:43.873687 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:43.874809 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell1:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:43.875506 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell0:SELECT=3 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:43.876672 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:44.733235 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e244c98c-189d-4928-ac70-129782f82747 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:44.765119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e244c98c-189d-4928-ac70-129782f82747 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.897280 Jul 19 15:22:44.765811 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 19 15:22:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:22:47.057095 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:47.058302 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-3676fba9-d64d-4bcc-8f67-2fadbe1f8422 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jul 19 15:22:47.059027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:47.522009 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-1052926d-2e01-44fe-9d8d-027eae27c4c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:47.543728 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:22:47.543728 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jul 19 15:22:47.574553 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-1052926d-2e01-44fe-9d8d-027eae27c4c2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.509147 Jul 19 15:22:47.575211 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:22:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:47.590014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:47.591425 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell1:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:47.592605 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:47.593822 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:47.813162 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-6c8ed08f-75b3-4634-9739-58fab65f2c16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:47.816003 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:22:47.816003 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:22:47.890313 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-6c8ed08f-75b3-4634-9739-58fab65f2c16 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306443 Jul 19 15:22:47.893277 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 19 15:22:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:22:50.125827 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-1052926d-2e01-44fe-9d8d-027eae27c4c2 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:50.126846 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-1052926d-2e01-44fe-9d8d-027eae27c4c2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 19 15:22:50.127314 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:50.793784 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-b1ea82aa-f194-471a-8bf9-f487156c1303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:50.812147 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:22:50.812147 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:22:50.837199 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-b1ea82aa-f194-471a-8bf9-f487156c1303 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703683 Jul 19 15:22:50.844248 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:22:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:50.850693 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-c3dcf08b-206d-49db-b5b4-ca8eb46ef379 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:50.852433 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:22:50.852433 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: warnings.warn(msg) Jul 19 15:22:50.887181 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-c3dcf08b-206d-49db-b5b4-ca8eb46ef379 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040351 Jul 19 15:22:50.909386 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 19 15:22:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:22:53.195514 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-b1ea82aa-f194-471a-8bf9-f487156c1303 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:53.196621 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-b1ea82aa-f194-471a-8bf9-f487156c1303 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 19 15:22:53.197160 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:53.595284 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-002aab10-4061-495a-8c58-c5d058cfd1fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "ram": 1024, "swap": 0}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:53.612897 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-002aab10-4061-495a-8c58-c5d058cfd1fc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.409923 Jul 19 15:22:53.613555 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:22:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:53.625374 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-c7bb841b-ef26-4a31-be8a-b3cd74a50ce6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:53.648234 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-c7bb841b-ef26-4a31-be8a-b3cd74a50ce6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026550 Jul 19 15:22:53.648795 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 19 15:22:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:22:55.883237 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-002aab10-4061-495a-8c58-c5d058cfd1fc admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:55.884270 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-002aab10-4061-495a-8c58-c5d058cfd1fc admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 19 15:22:55.884673 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:56.307555 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ae5d5750-6004-4f7c-ad26-f990192fbc4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:56.336614 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ae5d5750-6004-4f7c-ad26-f990192fbc4c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.440167 Jul 19 15:22:56.345437 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:22:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:56.350863 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-34ec9cc3-0515-44ba-9f93-efc2f1de3392 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:56.397871 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-34ec9cc3-0515-44ba-9f93-efc2f1de3392 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051136 Jul 19 15:22:56.398431 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 19 15:22:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:22:58.661122 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ae5d5750-6004-4f7c-ad26-f990192fbc4c admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:22:58.662149 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ae5d5750-6004-4f7c-ad26-f990192fbc4c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 15:22:58.662711 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:22:59.106294 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:59.124116 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455209 Jul 19 15:22:59.124785 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:22:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:22:59.137232 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-da81055b-913b-4ab8-b03b-576beb6fee03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:22:59.161222 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-da81055b-913b-4ab8-b03b-576beb6fee03 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028190 Jul 19 15:22:59.162011 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1335 bytes} [Tue Jul 19 15:22:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:23:01.467089 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:01.468146 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 19 15:23:01.468604 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:01.890537 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-75fae403-fe31-42e0-9a87-d1c498757f2f admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:01.914720 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-75fae403-fe31-42e0-9a87-d1c498757f2f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440120 Jul 19 15:23:01.915320 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 19 15:23:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:04.161057 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:04.162100 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-8b8aae9c-7814-4fea-98f7-e8ea44920433 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 19 15:23:04.162504 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:04.588870 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ab4470ab-541c-48f3-a579-45c3810b3988 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:04.612678 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ab4470ab-541c-48f3-a579-45c3810b3988 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.443991 Jul 19 15:23:04.613445 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:23:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:04.626929 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-f809634e-7536-4146-9236-9b006bd03887 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:04.651677 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-f809634e-7536-4146-9236-9b006bd03887 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029558 Jul 19 15:23:04.652825 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 19 15:23:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:23:06.873779 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ab4470ab-541c-48f3-a579-45c3810b3988 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:06.874805 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ab4470ab-541c-48f3-a579-45c3810b3988 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 19 15:23:06.875204 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:07.282264 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e88323e8-8890-4378-bdb4-be4f09283593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "id": "2"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:07.302511 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e88323e8-8890-4378-bdb4-be4f09283593 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421496 Jul 19 15:23:07.303172 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:23:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:23:07.315807 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4e01e0ad-68f4-498e-a4c6-48438c53954a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:07.338731 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-4e01e0ad-68f4-498e-a4c6-48438c53954a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026662 Jul 19 15:23:07.339297 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 19 15:23:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:23:09.565373 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e88323e8-8890-4378-bdb4-be4f09283593 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:09.566537 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e88323e8-8890-4378-bdb4-be4f09283593 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 19 15:23:09.566951 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:09.940429 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-1f00be34-57bf-4a9f-9827-98cfd8be184d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "3", "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:09.957840 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-1f00be34-57bf-4a9f-9827-98cfd8be184d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.385066 Jul 19 15:23:09.958405 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:23:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:23:09.971413 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-6faa492a-0915-4006-9f9c-c51b72c72269 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:09.994661 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-6faa492a-0915-4006-9f9c-c51b72c72269 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027110 Jul 19 15:23:09.995510 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 19 15:23:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:23:12.302019 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-1f00be34-57bf-4a9f-9827-98cfd8be184d admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:12.303015 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-1f00be34-57bf-4a9f-9827-98cfd8be184d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jul 19 15:23:12.303908 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:12.768356 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-64c12cf9-2bbd-4c16-bda8-f785a5c2c2e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:12.792322 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-64c12cf9-2bbd-4c16-bda8-f785a5c2c2e4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479427 Jul 19 15:23:12.793222 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:23:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:12.805413 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4e119153-8e54-4373-b158-17eedd175259 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:12.830553 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-4e119153-8e54-4373-b158-17eedd175259 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028800 Jul 19 15:23:12.831380 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 19 15:23:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:23:15.078126 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-64c12cf9-2bbd-4c16-bda8-f785a5c2c2e4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:15.079138 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-64c12cf9-2bbd-4c16-bda8-f785a5c2c2e4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 19 15:23:15.079547 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:15.603352 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:15.622145 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.536635 Jul 19 15:23:15.623293 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1282 bytes} [Tue Jul 19 15:23:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:15.635014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-544a6f30-c6ed-4754-b5f3-dc570179f206 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:15.643263 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:15.662166 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-544a6f30-c6ed-4754-b5f3-dc570179f206 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030722 Jul 19 15:23:15.685425 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1332 bytes} [Tue Jul 19 15:23:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:23:35.614842 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:35.615862 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 19 15:23:35.616263 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:23:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:35.626824 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:36.006522 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-c5953df9-c958-4e21-87aa-256aa5c7dd38 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:36.023500 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-c5953df9-c958-4e21-87aa-256aa5c7dd38 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401360 Jul 19 15:23:36.024034 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 19 15:23:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:37.106425 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:37.107686 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fa3a3efc-d690-4049-9f59-5e114b03b34d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Jul 19 15:23:37.108116 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:37.632515 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-01ed9d4d-1c59-49b0-a55c-05fa63efe60a admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:37.638100 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-01ed9d4d-1c59-49b0-a55c-05fa63efe60a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-01ed9d4d-1c59-49b0-a55c-05fa63efe60a admin admin] Request method failure captured: Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept: application/json Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Host: 10.222.0.42 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABi1sx5dsPct3L2gNpRStWE1WsXjY2byfLgNjpX_HbqLET3lTdakamA78SCkh9bssmS7CXi0w5HHSkEeb5VuOR6FdDTmPYzcQ3DPUfnNUuxF0H3k-cOXrh30F5v32RgQ1uXRmXq0l7yG0UoLiR20Rolq68FL_cLSRWf_cr3_nM81Ck_4I8 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Role: member,reader,admin Jul 19 15:23:37.642206 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Roles: member,reader,admin Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User: admin Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: method: > Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: exception: Flavor 42 could not be found. Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: action_args: {'id': '42'} Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:37.643860 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:37.644857 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.646119 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-01ed9d4d-1c59-49b0-a55c-05fa63efe60a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:37.647254 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-01ed9d4d-1c59-49b0-a55c-05fa63efe60a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396926 Jul 19 15:23:37.647254 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 19 15:23:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:37.653127 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-16e2f577-7ce5-48e0-b591-29273341f21f admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:37.656271 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:37.675630 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-16e2f577-7ce5-48e0-b591-29273341f21f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026040 Jul 19 15:23:37.676174 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:23:37.686406 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-c140cf88-0a24-4dec-a92c-34d37db7d6b5 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:37.707596 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-c140cf88-0a24-4dec-a92c-34d37db7d6b5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025349 Jul 19 15:23:37.708127 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:37.718403 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-a75b260a-d35c-49bf-aacc-8c680ae9df68 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:37.724393 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-a75b260a-d35c-49bf-aacc-8c680ae9df68 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-a75b260a-d35c-49bf-aacc-8c680ae9df68 admin admin] Request method failure captured: Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.42 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABi1sx5dsPct3L2gNpRStWE1WsXjY2byfLgNjpX_HbqLET3lTdakamA78SCkh9bssmS7CXi0w5HHSkEeb5VuOR6FdDTmPYzcQ3DPUfnNUuxF0H3k-cOXrh30F5v32RgQ1uXRmXq0l7yG0UoLiR20Rolq68FL_cLSRWf_cr3_nM81Ck_4I8 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Role: member,reader,admin Jul 19 15:23:37.727627 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Roles: member,reader,admin Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User: admin Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: method: > Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: exception: Flavor 42 could not be found. Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '42'} Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:37.728956 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:37.729817 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:37.731014 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-a75b260a-d35c-49bf-aacc-8c680ae9df68 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:37.732620 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-a75b260a-d35c-49bf-aacc-8c680ae9df68 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015175 Jul 19 15:23:37.732620 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 19 15:23:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 15:23:38.721963 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-c140cf88-0a24-4dec-a92c-34d37db7d6b5 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:38.723005 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-c140cf88-0a24-4dec-a92c-34d37db7d6b5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 19 15:23:38.723400 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:39.262133 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-09867977-41c9-44f9-8f6e-65371ba79f54 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:39.267835 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-09867977-41c9-44f9-8f6e-65371ba79f54 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-09867977-41c9-44f9-8f6e-65371ba79f54 admin admin] Request method failure captured: Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.42 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABi1sx6h9ipCSNgQ0JrjdXDQutmLQHNm50aw_U3DCpYsqPJl4EcgB4zMBBe6VgDAwe0Fph6RYbGa-EAbZZyosnhZw7Kql_YTb85lEfBrcGIo2l8ZpT59ecWXumNQFAtPBwsM8MuieZYsA2fz7uGrmeE2jlLrgvgKivswkadlvqVDTizVM0 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Role: member,reader,admin Jul 19 15:23:39.269378 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Roles: member,reader,admin Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User: admin Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: method: > Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: exception: Flavor 84 could not be found. Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '84'} Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:39.270819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:39.271625 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.272787 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-09867977-41c9-44f9-8f6e-65371ba79f54 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:39.273867 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-09867977-41c9-44f9-8f6e-65371ba79f54 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.410363 Jul 19 15:23:39.273867 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 19 15:23:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:39.280921 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-75c940c1-9c25-498c-9e2b-88ccc89b7545 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:39.295436 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-75c940c1-9c25-498c-9e2b-88ccc89b7545 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018046 Jul 19 15:23:39.295993 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:39.305516 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9c0942b0-7e85-42d6-9208-785cc35d530e admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:39.321352 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9c0942b0-7e85-42d6-9208-785cc35d530e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019292 Jul 19 15:23:39.321894 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:39.331935 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e74aff0c-8152-4acf-b1c7-21418e9148e6 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:39.337487 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-e74aff0c-8152-4acf-b1c7-21418e9148e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e74aff0c-8152-4acf-b1c7-21418e9148e6 admin admin] Request method failure captured: Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept: application/json Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Host: 10.222.0.42 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABi1sx6h9ipCSNgQ0JrjdXDQutmLQHNm50aw_U3DCpYsqPJl4EcgB4zMBBe6VgDAwe0Fph6RYbGa-EAbZZyosnhZw7Kql_YTb85lEfBrcGIo2l8ZpT59ecWXumNQFAtPBwsM8MuieZYsA2fz7uGrmeE2jlLrgvgKivswkadlvqVDTizVM0 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Role: member,reader,admin Jul 19 15:23:39.338987 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Roles: member,reader,admin Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User: admin Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: method: > Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: exception: Flavor 84 could not be found. Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: action_args: {'id': '84'} Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:39.340625 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:39.342262 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:39.343648 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-e74aff0c-8152-4acf-b1c7-21418e9148e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:39.344874 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-e74aff0c-8152-4acf-b1c7-21418e9148e6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012049 Jul 19 15:23:39.344874 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Jul 19 15:23:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:40.308629 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9c0942b0-7e85-42d6-9208-785cc35d530e admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:40.309683 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9c0942b0-7e85-42d6-9208-785cc35d530e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jul 19 15:23:40.310134 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:40.833848 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-6e297dad-fa30-44dd-9c72-f58c7a1329dc admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:40.839523 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.wsgi [None req-6e297dad-fa30-44dd-9c72-f58c7a1329dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-6e297dad-fa30-44dd-9c72-f58c7a1329dc admin admin] Request method failure captured: Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept: application/json Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Accept-Encoding: gzip, deflate Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Connection: keep-alive Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Content-Length: 0 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Host: 10.222.0.42 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Openstack-System-Scope: None Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: User-Agent: python-novaclient Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Auth-Token: gAAAAABi1sx8gon64qWWP3xHPDCJ3RkinGiKjqn2Wc-R0PG6JwAGcQU303-NPu376jeSVrLbJ4dv4_7JfuxvYP7QTd2N1o_GVAd0gFTpKbBLdJgWgyCDHS25zuO73H3l-bIWySqlU_ffIEyoSwrQg80048ban13COPWO25kYrb2Gn-ABAIX_gKw Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Id: None Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Domain-Name: None Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Identity-Status: Confirmed Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Is-Admin-Project: True Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Id: default Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Domain-Name: Default Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Project-Name: admin Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Role: member,reader,admin Jul 19 15:23:40.841000 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Roles: member,reader,admin Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant: admin Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-Tenant-Name: admin Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User: admin Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Id: default Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Domain-Name: Default Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: X-User-Name: admin Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: method: > Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: exception: Flavor 451 could not be found. Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: action_args: {'id': '451'} Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:40.842640 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:40.843668 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.845014 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-6e297dad-fa30-44dd-9c72-f58c7a1329dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:40.846387 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-6e297dad-fa30-44dd-9c72-f58c7a1329dc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394736 Jul 19 15:23:40.846387 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:23:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:40.852123 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-3b00b70c-25e7-4836-a701-d3d37481d39f admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:40.866438 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-3b00b70c-25e7-4836-a701-d3d37481d39f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017877 Jul 19 15:23:40.866966 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:40.876767 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:40.891872 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018914 Jul 19 15:23:40.892407 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Jul 19 15:23:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:23:40.901533 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ab7f0be9-2738-4c54-9c5f-d268eade3249 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:40.906859 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-ab7f0be9-2738-4c54-9c5f-d268eade3249 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ab7f0be9-2738-4c54-9c5f-d268eade3249 admin admin] Request method failure captured: Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.42 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABi1sx8gon64qWWP3xHPDCJ3RkinGiKjqn2Wc-R0PG6JwAGcQU303-NPu376jeSVrLbJ4dv4_7JfuxvYP7QTd2N1o_GVAd0gFTpKbBLdJgWgyCDHS25zuO73H3l-bIWySqlU_ffIEyoSwrQg80048ban13COPWO25kYrb2Gn-ABAIX_gKw Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Role: member,reader,admin Jul 19 15:23:40.908327 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Roles: member,reader,admin Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bb6648f966d4104a0136e3bb203cb76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bb6648f966d4104a0136e3bb203cb76"}]}] Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: 5bb6648f966d4104a0136e3bb203cb76 Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User: admin Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Id: 669959f6d82b46b1b551b6c19bf21c50 Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: method: > Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: exception: Flavor 451 could not be found. Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '451'} Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:23:40.910027 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:40.910993 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jul 19 15:23:40.912296 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ab7f0be9-2738-4c54-9c5f-d268eade3249 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:23:40.913580 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ab7f0be9-2738-4c54-9c5f-d268eade3249 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011634 Jul 19 15:23:40.913580 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:23:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:41.868566 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:41.869661 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 19 15:23:41.870059 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:42.398156 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-b9e1b0bd-915c-4c58-aefd-f49358aea3e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:42.417288 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-b9e1b0bd-915c-4c58-aefd-f49358aea3e1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408344 Jul 19 15:23:42.417836 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 19 15:23:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:43.386641 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:43.387642 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 19 15:23:43.388041 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:44.028409 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9fdebd91-d8cb-48bd-ace7-2075bc8fc0e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:44.046865 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9fdebd91-d8cb-48bd-ace7-2075bc8fc0e7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.520368 Jul 19 15:23:44.047426 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 19 15:23:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:45.022439 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:45.023447 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 19 15:23:45.023850 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:45.552547 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-537a195c-ee64-4b20-b1cd-5605fb963613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:45.569372 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-537a195c-ee64-4b20-b1cd-5605fb963613 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.405390 Jul 19 15:23:45.569910 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 19 15:23:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:46.588960 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:46.590038 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 19 15:23:46.590437 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:23:47.108073 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-868683cb-1e02-440d-ac80-52b675791f77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:23:47.127485 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-868683cb-1e02-440d-ac80-52b675791f77 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400219 Jul 19 15:23:47.127968 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Jul 19 15:23:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:23:48.088573 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:48.089610 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 19 15:23:48.090007 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:23:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:23:48.609863 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ca174f57-b0f9-4df1-8199-6fb2b4641ef5 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:23:48.628532 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ca174f57-b0f9-4df1-8199-6fb2b4641ef5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400488 Jul 19 15:23:48.629057 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Jul 19 15:23:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:24:40.710478 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:40.711481 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-0e56a848-6b4d-4524-ac44-ea4ef371abe4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 19 15:24:40.711881 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 930 bytes} [Tue Jul 19 15:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:24:40.722488 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:41.096822 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-c0d78ebc-f312-4ad2-8294-c8341e750f6e admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:41.116456 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-c0d78ebc-f312-4ad2-8294-c8341e750f6e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398586 Jul 19 15:24:41.116992 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1291 bytes} [Tue Jul 19 15:24:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:24:41.138100 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG dbcounter [-] [103274] Writing DB stats nova_api:SELECT=14 {{(pid=103274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:24:41.141926 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-ad122dcd-bc99-4852-8a28-34c04c656bc3 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:41.149852 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-ad122dcd-bc99-4852-8a28-34c04c656bc3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013183 Jul 19 15:24:41.150382 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1282 bytes} [Tue Jul 19 15:24:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:24:41.162651 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-804aa2a8-aeb8-4955-8c54-a240fe4b3283 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:41.170490 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-804aa2a8-aeb8-4955-8c54-a240fe4b3283 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011404 Jul 19 15:24:41.170808 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1285 bytes} [Tue Jul 19 15:24:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:24:41.183087 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:41.190713 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011369 Jul 19 15:24:41.191254 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1285 bytes} [Tue Jul 19 15:24:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:24:41.202997 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-0f6ed628-2eff-42df-b07b-3511d5cc2811 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:24:41.210488 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-0f6ed628-2eff-42df-b07b-3511d5cc2811 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011343 Jul 19 15:24:41.210996 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1282 bytes} [Tue Jul 19 15:24:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:28:12.725416 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:12.726443 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 19 15:28:12.726850 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:28:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:28:12.870421 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=6 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:13.031453 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:13.032633 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:13.032633 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:28:13.033906 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:13.034313 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:13.035101 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:13.035530 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:13.069930 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-8008163e-07a2-45cc-a53c-a0361cd1864d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200999 Jul 19 15:28:13.070484 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:28:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:28:13.909818 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:13.910827 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 19 15:28:13.911227 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:28:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:28:14.111005 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:14.112221 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:14.112221 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:28:14.113440 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:14.113886 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:14.114713 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:14.115174 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:14.134580 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-8ed006fd-cc17-471e-a292-d2f05facfe79 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080833 Jul 19 15:28:14.135149 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:28:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:28:25.379310 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:25.380326 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 19 15:28:25.380734 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:28:25.527398 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:25.528110 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell1:SELECT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:25.528864 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=8 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:25.577160 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:25.578384 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:25.578384 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:28:25.579591 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:25.580033 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:25.580819 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:25.581292 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:25.605796 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-1cca37af-4f53-49c3-9398-9ed699679f00 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082987 Jul 19 15:28:25.606275 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:28:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:28:26.431376 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: DEBUG nova.api.openstack.wsgi [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] Calling method '>' {{(pid=103274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:26.432376 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: INFO nova.api.openstack.requestlog [None req-99e5d83a-676c-4b85-840a-53a4ce60f268 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jul 19 15:28:26.432777 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: [pid: 103274|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Jul 19 15:28:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:28:26.624123 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:28:26.625312 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:28:26.625312 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jul 19 15:28:26.626479 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:26.626914 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:26.627701 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:28:26.628124 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:28:26.649656 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-4636a116-89ed-4bf3-a5b4-869265a796f5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077983 Jul 19 15:28:26.650455 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Jul 19 15:28:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:29:24.254594 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: Tue Jul 19 15:29:24 2022 - graceful shutdown triggered... Jul 19 15:29:24.254021 dv-cinder-849846-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 15:29:24.255472 dv-cinder-849846-2-iscsi devstack@n-api.service[103274]: Gracefully killing worker 1 (pid: 103274)... Jul 19 15:29:24.255908 dv-cinder-849846-2-iscsi devstack@n-api.service[103275]: Gracefully killing worker 2 (pid: 103275)... Jul 19 15:29:25.255028 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: worker 1 buried after 1 seconds Jul 19 15:29:25.255438 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: worker 2 buried after 1 seconds Jul 19 15:29:25.255438 dv-cinder-849846-2-iscsi devstack@n-api.service[103273]: goodbye to uWSGI. Jul 19 15:29:25.256632 dv-cinder-849846-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 15:29:25.257229 dv-cinder-849846-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 15:29:25.260071 dv-cinder-849846-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 15:29:25.269858 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 15:29:25.272428 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:29:25 2022] *** Jul 19 15:29:25.272591 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:29:25.272725 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:29:25.272841 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: nodename: dv-cinder-849846-2-iscsi Jul 19 15:29:25.272954 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: machine: x86_64 Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: clock source: unix Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: pcre jit disabled Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: detected number of CPU cores: 4 Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: current working directory: / Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: your processes number limit is 47680 Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: your memory page size is 4096 bytes Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: detected max file descriptor number: 2048 Jul 19 15:29:25.273093 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: lock engine: pthread robust mutexes Jul 19 15:29:25.273906 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: thunder lock: enabled Jul 19 15:29:25.273906 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 15:29:25.273906 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:29:25.318431 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: Python main interpreter initialized at 0x55bf77b2b9c0 Jul 19 15:29:25.318431 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: python threads support enabled Jul 19 15:29:25.318431 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: your server socket listen backlog is limited to 100 connections Jul 19 15:29:25.318431 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:29:25.318869 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:29:25.318869 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: *** Operational MODE: preforking *** Jul 19 15:29:25.319057 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:29:25.319057 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: spawned uWSGI master process (pid: 117992) Jul 19 15:29:25.319281 dv-cinder-849846-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 15:29:25.320353 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: spawned uWSGI worker 1 (pid: 118006, cores: 1) Jul 19 15:29:25.320353 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: spawned uWSGI worker 2 (pid: 118007, cores: 1) Jul 19 15:29:25.320353 dv-cinder-849846-2-iscsi devstack@n-api.service[117992]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:29:25.978923 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:29:25.979535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:29:27.174492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:29:27.174492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: from cryptography.utils import int_from_bytes Jul 19 15:29:27.175139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:29:27.175139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: from cryptography.utils import int_from_bytes Jul 19 15:29:27.184749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:29:27.184749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: from cryptography.utils import int_from_bytes Jul 19 15:29:27.185358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:29:27.185358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: from cryptography.utils import int_from_bytes Jul 19 15:29:29.498075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:29:29.498645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:29:29.498847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:29:29.499212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:29:29.499465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:29:29.499850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.500170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.500487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.500818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.501126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.501459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.501774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.502087 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.502411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.502669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.502979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.503301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-2-iscsi {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.503621 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.503924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.504230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.504543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.504849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.505186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.505491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.505990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.506413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.506719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.507048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.507381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.508821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.508821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.508821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.508821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.509158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.509234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.509595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-2-iscsi {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.509913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.510227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.510600 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.511017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.511328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.511672 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.511994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.512321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.512454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:29:29.512854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:29:29.513255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:29:29.513491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.513622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:29:29.513885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:29:29.514218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.514328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.514589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.514911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.515047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.515231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.515569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.515774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.515880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.516191 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.516474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.516583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.516830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.517092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.517322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.517423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.517750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-2-iscsi {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.517991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.518093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.518372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.518676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.518782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.518996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.519305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.519495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.519606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.519928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.520158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.520441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.520754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.520907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.521059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.521398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.521586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.521737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.522055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.522296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.522400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.522675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.522987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.523090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.523308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.523616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.523823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.524017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-2-iscsi {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.524337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.524540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.524651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.524956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.525408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.525665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.525945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.526074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.526275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.526599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.526830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.526938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.527804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.528083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.528193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.528452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.528776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.528937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.529098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.529430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.529718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.529825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.530041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.530372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.530575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.530688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.530975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.531228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.531416 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.531532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.531848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.532131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.532249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.532485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.532737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.532971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.533088 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.533327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.533653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.533823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.533962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.534275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.534572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.534680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.534880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.535187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.535424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.535543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.535790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.536096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.536292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.536411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.536719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.537029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.537162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.537372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.537697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.537848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.538097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.538350 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.538483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.538658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.538998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.539185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.539319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.539630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.539721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.539954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.540206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.540305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.540579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.540888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.541189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.541298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.541530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.541787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.541891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.542164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.542402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.542496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.542761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.543588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.543936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.544047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.544213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.544522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.544641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.544827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.545148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.545263 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.545464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.545775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.545887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.546081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.546351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.546456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.546682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.546990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.547298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.547604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.547905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.548231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.548550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.548857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.549248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.549562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.549987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.550386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.550704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.551014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.551341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.552137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.552450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.552780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.553097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.553437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.553763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.554073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.555361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.555548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.556069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.556220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.556450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.557989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.558149 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.558260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.558538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.559073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.559327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.559587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.560483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.560601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.560724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.560724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.560897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.561211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.561533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.562114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.562260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.562551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.562750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.563144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.563369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.563615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.563940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.564109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.564281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.564572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.564688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.564884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.565223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.565389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.565587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.565861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.565992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.566210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.566399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.566511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.566842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.566978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.567167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.567372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.567491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.567792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.567899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.568125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.568369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.568475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.568755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.568868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.569103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.569292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.569489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.569738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.569843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.570127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.570240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.570460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.570776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.571093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.571408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.571581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.571743 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.572051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.572173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.572372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.572584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.572691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.572996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.573096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.573354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.573625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.573735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.574163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.574316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.574658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.574937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.575115 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.575278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.575429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.575606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.575748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.575896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.576047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.576189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.576344 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.576485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.576634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.576775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.576928 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.577078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.577258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.577403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.577558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.577747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.577934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.578166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.578319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.578506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.578654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.578795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.578944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.579095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.579245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.579394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.579579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.579726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.579886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.580035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.580185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.580326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.580487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.580636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.580788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.580988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.581169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.581450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.581652 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.581802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.581990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.582145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.582303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.582445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.582630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.582792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.582949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.583099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.583248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.583390 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.583536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.583759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.583926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.584076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.584217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.584357 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.584498 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.584744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.585031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.585223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.585372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.585515 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:29:29.585658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.585815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.585957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.586997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587429 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.587923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.588944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.589093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.589292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.589448 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.590138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.590291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.590439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.590649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.590900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.591990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.592914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.593969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.594218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.594383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.594527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.594676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.594922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.595959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.596883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.597980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.598988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599452 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.599943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.600984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.601125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.601356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.601509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.601855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.602872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603767 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.603916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.604942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.606009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.606161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.606352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.606501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.606862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607023 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.607957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.608995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.609218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.609381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.609525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.609525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.609880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.610923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611232 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.611987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.612992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.613924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614429 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614429 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.614989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.615949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.616893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.617942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618836 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.618991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.619871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620619 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.620948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.621266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.621541 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.621694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.621853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.622953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.623994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.624179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.624325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.624467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.624647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.624878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.625934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.626941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627090 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627344 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627644 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.627946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.628969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.629886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.630917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631058 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.631907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.632975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.633944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.634863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635391 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635541 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.635776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.636073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.636224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.636373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.637093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.637502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.637679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.637679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638165 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.638727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.639180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.639394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.639541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.639541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.639923 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.640081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.640384 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.640536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.640688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.640872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.641993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.642690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.642852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.643913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.644739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.645325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.645553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.645757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.645979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.646953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.647232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.647389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.647549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.647807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.647965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.648897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.649879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.650034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.650467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.650627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.650806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.650951 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.651685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.652024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.652250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.652425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.652708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.652865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653015 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.653860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.654958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.655896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.656919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.657949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.658842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.659803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.660948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.661038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.661661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.661829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.661982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.662126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.662275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.662438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.662757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.662928 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663253 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.663998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.664921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665430 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665876 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.665876 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.666292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.666449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.666613 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.666797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.666797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.667105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.667105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.667408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.667408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.667408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.668489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.668489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.668796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.669110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.669451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.669760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.670135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.670286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.670476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.670641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.670786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.671987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.672137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.672287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.672442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.672585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.672751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673811 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.673962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.674895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.675982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.676143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.676458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.676608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.676751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.676893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677043 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.677849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.678879 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679182 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.679907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.680998 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.681936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.682227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.682386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.682536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.682678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.682831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.683029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.683504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.683674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.683827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.683985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.684924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685067 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.685993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.686143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.686293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.686586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.686740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.686740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687317 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.687894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.688914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.689971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690122 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.690877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.691914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.692861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693429 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.693861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.694922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.695966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.696873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.697950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.698093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.698235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.698390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.698534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.698683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.699527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.699698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.699847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.700893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.701913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.702956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.703962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.704242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.704392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.704612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.704758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.704900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.705043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.705817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.705817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.706109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.706252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.706405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.706556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.706843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707469 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.707755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.708970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.709279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.709439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.709592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.709736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.709879 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.710933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.711954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712103 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.712976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.713867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.714153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.714303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.714454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.715148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.715301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.715443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.715443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.715806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716163 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.716952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.717874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718612 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718805 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.718893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.719878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720591 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.720996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.721231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.721353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.721550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.721694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.721862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.722882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.723995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.724983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.725236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.725347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.725563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.725659 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.725875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.726963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727276 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.727897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.728971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.729954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.730925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.731894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.732999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.733941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.734233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.734383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.734533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.734747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.734917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.735999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736149 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.736928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737790 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.737940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.738863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739811 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.739962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.740913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.741883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.742970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.743949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744600 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.744927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.745935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.746845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.747944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.748864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.749968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750723 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.750889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.751993 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752142 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.752976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.753941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754090 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754548 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.754863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.755940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.756869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.757847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.758962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.759903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.760987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.761162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.761332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762263 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.762978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.763212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.763306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.763525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.763618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.763863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764280 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.764896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.765120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.765234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.765459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.765743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.765844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766498 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.766817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.767973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.768930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.769899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770771 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.770930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.771877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.772988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773182 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.773975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.774210 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.774372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.774551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.774709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.774858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.775006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.775428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.775599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.775758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.775907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.776987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.777778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.777887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.777986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118007) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:29:29.778538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.778777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.779093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.779426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.779747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.780065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.780442 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.780936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.781531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.781880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.782208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.782559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.782900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.783215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.783530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.783843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.784272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.784495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.784815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.785133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.785475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.785789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.786106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.786423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.786740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.787055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.787372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.787685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.787999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.788315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.788639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.789001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.789352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.789675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.789998 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.790328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.790663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.791137 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.791319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.791573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.791892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.792232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.792553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.792996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.793491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.793908 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.794237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.794566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.794882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.795212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.795544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.795859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.796186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.796502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.796841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.797211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.797555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.797893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.798209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.798522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.798835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.799151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.799504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.799787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.800106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.800417 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.800813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.801302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.801484 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.801675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.801986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.802299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.802607 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.802916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.803225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.803533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.803841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.804149 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.804464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.804771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.805082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.805415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.805727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.806037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.806384 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.806724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.807046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.807378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.807696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.808027 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.808390 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.808726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.809058 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.809413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.809731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.810077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.810394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.810709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.811022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.811337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.811656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.811970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.812310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.812639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.812951 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.813310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.813657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.813988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.814311 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.814627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.814963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.815277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.815592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.815907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.816221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.816535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.816856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.817198 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.817516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.817839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.818162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.818501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.818834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.819150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.819481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.819862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.820179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.820497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.820847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.821214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.821528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.821843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.822155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:29:29.822404 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118006) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:29:29.930701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO dbcounter [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Registered counter for database nova_api Jul 19 15:29:29.952784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_db.sqlalchemy.engines [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:29.959954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writer thread running {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:29.975238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO dbcounter [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Registered counter for database nova_api Jul 19 15:29:29.994853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_db.sqlalchemy.engines [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.002213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writer thread running {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.016884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.context [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38(cell1) {{(pid=118007) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:29:30.020992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:29:30.022609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:29:30.023430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:29:30.025723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:29:30.027986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO dbcounter [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Registered counter for database nova_cell0 Jul 19 15:29:30.032000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO dbcounter [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Registered counter for database nova_cell1 Jul 19 15:29:30.039263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_db.sqlalchemy.engines [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.040928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_db.sqlalchemy.engines [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.047565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writer thread running {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.048891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writer thread running {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.059937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.context [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38(cell1) {{(pid=118006) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:29:30.064085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:29:30.065714 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:29:30.066567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:29:30.068579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:29:30.070591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO dbcounter [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Registered counter for database nova_cell0 Jul 19 15:29:30.075320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO dbcounter [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Registered counter for database nova_cell1 Jul 19 15:29:30.083007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_db.sqlalchemy.engines [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.085236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_db.sqlalchemy.engines [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.090407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writer thread running {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.092962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writer thread running {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.195176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO dbcounter [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Registered counter for database nova_cell0 Jul 19 15:29:30.204997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_db.sqlalchemy.engines [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118007) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.209621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writer thread running {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.243683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO dbcounter [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Registered counter for database nova_cell0 Jul 19 15:29:30.251614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_db.sqlalchemy.engines [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118006) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:29:30.256410 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writer thread running {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:29:30.527183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: WARNING keystonemiddleware.auth_token [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:29:30.534660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: WARNING keystonemiddleware.auth_token [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:29:30.577319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: WARNING keystonemiddleware.auth_token [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:29:30.585105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: WARNING keystonemiddleware.auth_token [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:29:30.878552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: WARNING keystonemiddleware.auth_token [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:29:30.884513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: WARNING keystonemiddleware.auth_token [None req-3f9bacf0-d1a7-4e52-833c-37417a1c1f2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:29:30.891393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bf77b2b9c0 pid: 118007 (default app) Jul 19 15:29:30.934725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: WARNING keystonemiddleware.auth_token [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:29:30.940687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: WARNING keystonemiddleware.auth_token [None req-cef2a20a-2afa-4a8e-8f00-5d8b765fb2ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:29:30.946896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bf77b2b9c0 pid: 118006 (default app) Jul 19 15:30:12.487633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:12.488508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:12.489727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:12.490482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:13.804344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-65a47beb-b39b-46e8-bc0d-0fee44b9d202 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Action: 'create', calling method: .version_select at 0x7f83294d6c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2096095992", "metadata": {"Type": "work"}}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:15.812399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-65a47beb-b39b-46e8-bc0d-0fee44b9d202 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.341935 Jul 19 15:30:15.814080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Jul 19 15:30:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3345 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 15:30:15.830893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:15.834383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:15.837068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:15.840133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:16.437467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eabf4b7b-1c6c-43dc-944e-0a988465dfd0 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Calling method '.version_select at 0x7f8329524790>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:17.105153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eabf4b7b-1c6c-43dc-944e-0a988465dfd0 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09" status: 200 len: 354 microversion: 2.1 time: 1.281253 Jul 19 15:30:17.107514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:30:15 2022] GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 => generated 354 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:30:17.121034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f0c197c2-5a5b-44b4-bab0-7646bd9ddd89 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Calling method '.version_select at 0x7f832939fa60>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:17.188858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f0c197c2-5a5b-44b4-bab0-7646bd9ddd89 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09" status: 200 len: 354 microversion: 2.1 time: 0.074654 Jul 19 15:30:17.189850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:30:17 2022] GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:30:17.210369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-becad600-128c-4050-b11f-2e9fee154bd1 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Calling method '.version_select at 0x7f83293eba60>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:17.299891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-becad600-128c-4050-b11f-2e9fee154bd1 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09" status: 202 len: 0 microversion: 2.1 time: 0.094916 Jul 19 15:30:17.301601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:30:17 2022] DELETE /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:30:17.314764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f996acd8-d0ff-4361-bbb8-e74c7e17d2b3 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Calling method '.version_select at 0x7f832939fca0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:17.494322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f996acd8-d0ff-4361-bbb8-e74c7e17d2b3 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09" status: 200 len: 353 microversion: 2.1 time: 0.187962 Jul 19 15:30:17.495213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:30:17 2022] GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:30:18.507793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-084edd3c-c083-46f2-98a8-6c00c80ad591 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Calling method '.version_select at 0x7f83293a7160>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:18.550994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-084edd3c-c083-46f2-98a8-6c00c80ad591 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] HTTP exception thrown: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-084edd3c-c083-46f2-98a8-6c00c80ad591 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Request method failure captured: Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 HTTP/1.1 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4Ea7-EXOLfUwQASF7XTPhteBI9LabzbZyDtQ30PikX9znew36VRKARF_x7uL7R5TU53DIYAeHWJ4ZC5ksXf4JFmSl_wBg3ZgFBjJ0R6Xbl1pkiJM7zHT4TMAu1iivIg57ZIxyL9L-MTrDkmQ1AaYrT72QD2tyY5_PTT37etJEGuK0 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 732ecfbf08874525a7ecbdec9abf34eb Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesGetTestJSON-159463050 Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:30:18.555460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_732ecfbf08874525a7ecbdec9abf34eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/732ecfbf08874525a7ecbdec9abf34eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/732ecfbf08874525a7ecbdec9abf34eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/732ecfbf08874525a7ecbdec9abf34eb"}]}] Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesGetTestJSON-159463050 Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 732ecfbf08874525a7ecbdec9abf34eb Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesGetTestJSON-159463050 Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesGetTestJSON-159463050-project Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: b9dfaf168adf45618c828806ec285026 Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesGetTestJSON-159463050-project Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '409c8c56-54bc-4436-91fd-52fe77328a09'} Jul 19 15:30:18.556483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. (HTTP 404) (Request-ID: req-05c3add0-9dad-4c19-91b4-2119b5c4232c) Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:30:18.557763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:30:18.558574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:30:18.559446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. Jul 19 15:30:18.560237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:30:18.566511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-084edd3c-c083-46f2-98a8-6c00c80ad591 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] Returning 404 to user: Volume 409c8c56-54bc-4436-91fd-52fe77328a09 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:30:18.567649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-084edd3c-c083-46f2-98a8-6c00c80ad591 tempest-VolumesGetTestJSON-159463050 tempest-VolumesGetTestJSON-159463050-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09" status: 404 len: 109 microversion: 2.1 time: 0.064151 Jul 19 15:30:18.568744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:30:18 2022] GET /compute/v2.1/os-volumes/409c8c56-54bc-4436-91fd-52fe77328a09 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:30:28.685551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1640723981", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "networks": [{"uuid": "46070b39-fc33-4f71-b014-065d8c4b02ef"}]}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:28.898818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] validate_networks() for [('46070b39-fc33-4f71-b014-065d8c4b02ef', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:30:32.523170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:30:32.523788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:30:32.524209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:30:32.524468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:30:32.525357 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:30:32.587893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:32.588399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:32.589360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:32.589808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:32.645366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Getting quotas for project 2deb7182f86846e09269b7cba6fab758. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:32.656559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Getting quotas for user 064d7bbcf3684ccbafc5f3d1cb561d9a and project 2deb7182f86846e09269b7cba6fab758. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:32.689091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:30:32.694537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:30:32.848017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e1c7e455-4536-46f4-b030-b1441a7edd88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.506634 Jul 19 15:30:32.848983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 4/7] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 4508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:30:32.869493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-696d3053-27cc-4e68-8b85-1da370deadc3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:32.871119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-696d3053-27cc-4e68-8b85-1da370deadc3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:33.374477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-696d3053-27cc-4e68-8b85-1da370deadc3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:33.401689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-696d3053-27cc-4e68-8b85-1da370deadc3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1215 microversion: 2.1 time: 0.543036 Jul 19 15:30:33.412195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d27fa3f2-9f18-4632-a271-2f6b4cf126fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: .version_select at 0x7f8329312160>, body: {"keypair": {"name": "tempest-keypair-155074373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9CUDiDH453JjHU3R0G7Sla3cvp10EwlGEE/Rb8rZ3WMP1SQslZlkish3uUFYy1hjalZj7nRy5CMEeDDPI/3poHbjThMQj+AYF1S7FbJe/rWE3EDvan7AKDlmpN2DUDDg=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:33.413318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:32 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1215 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:33.505291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-d27fa3f2-9f18-4632-a271-2f6b4cf126fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for project 9bf94c44535545689ddc74bc82888a46. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:33.525974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-d27fa3f2-9f18-4632-a271-2f6b4cf126fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for user ddb5e1dec1904ae183e131ba95ed1ef2 and project 9bf94c44535545689ddc74bc82888a46. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:33.606103 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d27fa3f2-9f18-4632-a271-2f6b4cf126fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.978160 Jul 19 15:30:33.607959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 4/9] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Jul 19 15:30:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 981 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 15:30:34.312579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1aae7a9b-418a-41c7-be5f-34da3bebb78d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: .version_select at 0x7f832930ba60>, body: {"keypair": {"name": "tempest-keypair-683985719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXmD2FUOIMkYbz+2PZWgp0fGs+ht/hdn/FT4wYZE752dw3YtJYOQT5iCunJRD9H70gpHosBj6is/su9K2lePrX53Q0LeD2W+U+3JXZAMa1o4x1CXcFkYBxqVPVpE6zcDA=="}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:34.407297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-1aae7a9b-418a-41c7-be5f-34da3bebb78d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:34.427792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-1aae7a9b-418a-41c7-be5f-34da3bebb78d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:34.540104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1aae7a9b-418a-41c7-be5f-34da3bebb78d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.124551 Jul 19 15:30:34.541249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 6/10] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:30:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:30:34.550595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-db85d4a8-00a5-438d-91be-c72a52f41f8b tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:34.554779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-db85d4a8-00a5-438d-91be-c72a52f41f8b tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:34.762792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c3fadff8-41c5-429e-9da6-6869676a552d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: .version_select at 0x7f83293a7b80>, body: {"keypair": {"name": "tempest-keypair-170539260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ8pjK0pOpH7fdDmzNQSmAdGIeSE88GH3qMWjbB37biVxbgzeOlAJuoYRjLpP27uqNR1LZf3JHjdYNIGLUeO9rRsY8TNdbBKWM9PCbFqatYTocJePOEw11psTdSN04OCw=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:34.789880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-c3fadff8-41c5-429e-9da6-6869676a552d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for project 7d55d02d809143f682698fbb494f65f4. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:34.802845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-c3fadff8-41c5-429e-9da6-6869676a552d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for user 51eb5efc37ca4942831bc4d046f54da6 and project 7d55d02d809143f682698fbb494f65f4. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:34.840371 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c3fadff8-41c5-429e-9da6-6869676a552d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.921588 Jul 19 15:30:34.842398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 5/11] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:30:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:30:34.861896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-db85d4a8-00a5-438d-91be-c72a52f41f8b tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:34.873249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-db85d4a8-00a5-438d-91be-c72a52f41f8b tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1215 microversion: 2.1 time: 0.330734 Jul 19 15:30:34.877789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:34 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:35.899473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:35.901836 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:35.993236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:35.994017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:36.010840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:36.018687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:37.265004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:37.346695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-95f3d1d3-3732-4cd2-be43-2529a02d8827 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1211 microversion: 2.1 time: 1.450019 Jul 19 15:30:37.362161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 6/13] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:35 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1211 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:38.376892 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:38.378311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:38.409939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:38.415296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:38.423541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:38.424002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:39.167617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:39.228609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ad3512a1-4f89-4653-b099-093e846cb712 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1273 microversion: 2.1 time: 0.860819 Jul 19 15:30:39.231634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 8/14] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:38 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1273 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:40.256786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:40.258776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:40.277511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:40.278283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:40.279669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:40.285088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:40.944284 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:40.956798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ce3db0a8-d6b1-4229-bb7c-98337d88da79 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1273 microversion: 2.1 time: 0.703746 Jul 19 15:30:40.964698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:40 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1273 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:41.976343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:41.976964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:41.994757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:42.013632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:42.013632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:42.013632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:42.543666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:42.555362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6ef2fe2f-be73-4d72-8300-049d611f7af8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1273 microversion: 2.1 time: 0.583235 Jul 19 15:30:42.573429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:41 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1273 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:42.819862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-926264486", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b997d6e-f833-4b48-a8a4-81e5d09aad0b"}], "security_groups": [{"name": "tempest-securitygroup--613770756"}], "key_name": "tempest-keypair-155074373", "user_data": "}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:43.239850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-868067654", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49542e1b-6d90-46b8-a047-af4acb0cf796"}], "security_groups": [{"name": "tempest-securitygroup--455847881"}], "key_name": "tempest-keypair-170539260", "user_data": "}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:43.277321 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:44.823206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=8 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:44.873544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=14 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:50.951860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=12 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:52.552239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=14 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:52.962836 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:53.280412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:54.346574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] validate_networks() for [('49542e1b-6d90-46b8-a047-af4acb0cf796', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:30:54.349339 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] validate_networks() for [('6b997d6e-f833-4b48-a8a4-81e5d09aad0b', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:30:54.920967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:30:54.921768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:30:54.922435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:30:54.923248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:30:54.924246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:30:54.938821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:54.939512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:54.940407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:54.940917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:55.005807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for project 7d55d02d809143f682698fbb494f65f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:55.016527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for user 51eb5efc37ca4942831bc4d046f54da6 and project 7d55d02d809143f682698fbb494f65f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:55.032473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:30:55.035493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:30:55.118132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-85a4d337-d4aa-46f2-9be8-e3fd7dfa0037 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 11.882719 Jul 19 15:30:55.119066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 10/17] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:30:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 11885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:30:55.124119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:55.125337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:55.159495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:55.160949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:55.161847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:55.165399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:55.245131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:30:55.245838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:30:55.246591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:30:55.247170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:30:55.247741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:30:55.261789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:55.262409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:55.263385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:55.263985 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:55.335847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for project 9bf94c44535545689ddc74bc82888a46. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:55.348145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for user ddb5e1dec1904ae183e131ba95ed1ef2 and project 9bf94c44535545689ddc74bc82888a46. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:55.371029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:30:55.375283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:30:55.488419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-41adf18c-c527-4238-94e2-5af2f43f1715 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 12.675517 Jul 19 15:30:55.499896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 8/18] 10.222.0.42 () {62 vars in 1187 bytes} [Tue Jul 19 15:30:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 12688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 15:30:55.515229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1118747577", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc814b7d-034a-42a8-85dc-8ab08a546a8c"}], "security_groups": [{"name": "tempest-securitygroup--1633475440"}], "key_name": "tempest-keypair-683985719", "user_data": "}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:55.538675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:55.548057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-da8bc63d-fa64-4dcc-a660-809033e8fb88 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.427671 Jul 19 15:30:55.556344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:55 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:55.728912 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] validate_networks() for [('fc814b7d-034a-42a8-85dc-8ab08a546a8c', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:30:55.935595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-63c39120-0acf-48cb-927c-df0ecbb2936d req-538c6e05-3779-4ccd-99d9-74d8dbdbc21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f", "tag": "db4f9a30-49b2-423e-8440-422993fe5bf7"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:30:55.954541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-63c39120-0acf-48cb-927c-df0ecbb2936d req-538c6e05-3779-4ccd-99d9-74d8dbdbc21b service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:55.969481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-63c39120-0acf-48cb-927c-df0ecbb2936d req-538c6e05-3779-4ccd-99d9-74d8dbdbc21b service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.034511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-63c39120-0acf-48cb-927c-df0ecbb2936d req-538c6e05-3779-4ccd-99d9-74d8dbdbc21b service nova] Creating event network-changed:db4f9a30-49b2-423e-8440-422993fe5bf7 for instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f on hv-cinder-84984 Jul 19 15:30:56.035252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-63c39120-0acf-48cb-927c-df0ecbb2936d req-538c6e05-3779-4ccd-99d9-74d8dbdbc21b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 15:30:56.036814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75344582-554e-4875-8089-adba25d6de70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.037588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75344582-554e-4875-8089-adba25d6de70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.038533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75344582-554e-4875-8089-adba25d6de70 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.051862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75344582-554e-4875-8089-adba25d6de70 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.073028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.compute.rpcapi [None req-75344582-554e-4875-8089-adba25d6de70 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 15:30:56.073959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75344582-554e-4875-8089-adba25d6de70 None None] Releasing lock "compute-rpcapi-router" {{(pid=118007) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 15:30:56.113582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-75344582-554e-4875-8089-adba25d6de70 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.555120 Jul 19 15:30:56.113724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 12/20] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:30:56.126680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ec3dddd6-703d-463b-95b4-5353ebab333c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:56.131276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ec3dddd6-703d-463b-95b4-5353ebab333c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:56.287478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ec3dddd6-703d-463b-95b4-5353ebab333c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.296034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ec3dddd6-703d-463b-95b4-5353ebab333c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1236 microversion: 2.1 time: 0.180073 Jul 19 15:30:56.297797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 13/21] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:56 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1236 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:56.308108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:56.309945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:56.430590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.449069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.450914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.452063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3d81ed6f-f9ce-47e6-bfec-02e8b2aedc3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1280 microversion: 2.20 time: 0.152385 Jul 19 15:30:56.452623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 14/22] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:30:56 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1280 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:30:56.548233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:30:56.549646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:30:56.550622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:30:56.551288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:30:56.552293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:30:56.569498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:56.570252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:56.576001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.576617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.578683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.579846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.581032 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.584615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.585704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:56.587354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:56.639575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:30:56.646491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:30:56.669907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:30:56.672298 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:30:56.737160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bfeeb113-a774-4ff9-8eae-e145c0fcffaf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.233063 Jul 19 15:30:56.737852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 9/23] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:30:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:30:56.748371 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fd7df7f3-c0ee-49f6-a533-847be7fefbe9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:56.749300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fd7df7f3-c0ee-49f6-a533-847be7fefbe9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:56.916321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fd7df7f3-c0ee-49f6-a533-847be7fefbe9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.919666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:56.929640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-80e41709-8239-4501-9b51-9553000af829 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.364433 Jul 19 15:30:56.930781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 15/24] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:56 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:56.932936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fd7df7f3-c0ee-49f6-a533-847be7fefbe9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1241 microversion: 2.1 time: 0.188420 Jul 19 15:30:56.933534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 10/25] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:56 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:30:57.315323 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:57.315942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:57.330662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.338288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.339046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.339489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.471083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:57.471835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:57.481791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.485708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.486650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.489730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.646300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:57.656496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-73d5b4f1-bcae-4c49-89d9-01c320c73b98 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1288 microversion: 2.1 time: 0.344572 Jul 19 15:30:57.657285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 16/26] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:57 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1288 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:57.678768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:57.698950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:57.701037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:57.702419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-10b68607-aeda-4582-af1f-b670637ceec6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1340 microversion: 2.20 time: 0.235293 Jul 19 15:30:57.703132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 11/27] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:30:57 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1340 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:30:57.949279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:57.950187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:57.957881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:57.958418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:57.967114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.967685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.968495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.968940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.970584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.971047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:57.972091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:57.975376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:58.182551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.191360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1b09afd0-0876-4999-8414-453cb2995a86 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1293 microversion: 2.1 time: 0.237329 Jul 19 15:30:58.191940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 12/28] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:57 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1293 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:30:58.405717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.420149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b73bbec2-0f57-4476-9378-8b169d742450 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.476264 Jul 19 15:30:58.421175 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 17/29] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:57 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:58.676881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:58.677566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:58.687074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:58.687703 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:58.689459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:58.690008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:58.723360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:58.725240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:58.741224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:58.741725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:58.746606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:58.747063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:58.838923 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.846981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bc95b3bf-12ac-411c-a0e7-a334e3aaf0da tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1294 microversion: 2.1 time: 0.175253 Jul 19 15:30:58.847801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 13/30] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:58 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1294 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:30:58.906575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.916801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.918653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:58.920154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-770ba465-4b6e-4edf-941b-988bb3a3d60e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1338 microversion: 2.20 time: 0.202087 Jul 19 15:30:58.920794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 18/31] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:30:58 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:30:59.210472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:59.211395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:59.227234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.229503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:59.232325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.235146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:59.437437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:59.438148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:59.450089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.450784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:59.455544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:30:59.464571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.464571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:59.493615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b9c338c2-decd-47c9-9a88-7172af95ac55 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1299 microversion: 2.1 time: 0.270010 Jul 19 15:30:59.499890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 14/32] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:59 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:30:59.866439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:30:59.868273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:30:59.887961 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.889441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:30:59.892110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:30:59.893273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.437301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:00.455415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c0f2ddb3-f15e-4e85-a5ae-c41311c4f4d8 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 1.021812 Jul 19 15:31:00.457108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 19/33] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:59 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:00.463005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:00.464363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:00.478649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.486300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.488912 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.490557 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.631955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:00.643144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-31cb047b-ac7b-47b5-a115-5b5488d3c05b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.780488 Jul 19 15:31:00.648220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:30:59 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:00.666281 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:00.676948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:00.687777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.688522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.689566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.690209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.871583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:00.879652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4ad88a46-2ff1-46bb-9f81-9f89f8d2c205 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1299 microversion: 2.1 time: 0.228896 Jul 19 15:31:00.883975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 16/35] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:00 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:00.888745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-e2416f3b-6915-4657-9fd5-6e0d14d15362 req-060c27b5-8141-4bef-8e9f-a06ecbbe6b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6448684-07a9-4238-bcd7-8b1f4620d268", "tag": "8be689cb-9892-4bb4-bab2-3ee46f50f000"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:00.905809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e2416f3b-6915-4657-9fd5-6e0d14d15362 req-060c27b5-8141-4bef-8e9f-a06ecbbe6b7b service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.906491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e2416f3b-6915-4657-9fd5-6e0d14d15362 req-060c27b5-8141-4bef-8e9f-a06ecbbe6b7b service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.930976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-e2416f3b-6915-4657-9fd5-6e0d14d15362 req-060c27b5-8141-4bef-8e9f-a06ecbbe6b7b service nova] Creating event network-changed:8be689cb-9892-4bb4-bab2-3ee46f50f000 for instance a6448684-07a9-4238-bcd7-8b1f4620d268 on hv-cinder-84984 Jul 19 15:31:00.932202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e2416f3b-6915-4657-9fd5-6e0d14d15362 req-060c27b5-8141-4bef-8e9f-a06ecbbe6b7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 15:31:00.933530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.935066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.936028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:00.936601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:00.950065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.compute.rpcapi [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 15:31:00.951396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118006) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 15:31:00.993297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9f997754-3659-46c0-8ce2-b7e69dd3f7e4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105635 Jul 19 15:31:00.995031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 17/36] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:01.123575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:01.137980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:01.143217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:01.146902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-28db9865-a2d6-42bc-b014-05656c945e15 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.687997 Jul 19 15:31:01.147480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 20/37] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:00 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:01.476794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:01.478047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:01.512029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:01.512688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:01.513679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:01.516848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:01.665056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:01.665755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:01.677787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:01.678366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:01.680400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:01.682072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:02.426719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:02.445027 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4d8ad498-f62b-4a6c-a86b-bfc19ae8b7d6 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.973459 Jul 19 15:31:02.456351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 18/38] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:01 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:02.460533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:02.461883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:02.462601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:02.470033 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:02.470485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:02.472303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:02.472777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d28517c7-8120-4616-afbe-8035d00ec236 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.810184 Jul 19 15:31:02.473095 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:02.479581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 21/39] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:01 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:02.579370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-ae78d1c9-00d2-4e76-a195-971d85e24992 req-5ea38986-07f4-4244-8f8f-d4346d36482d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f", "name": "network-vif-plugged", "status": "completed", "tag": "db4f9a30-49b2-423e-8440-422993fe5bf7"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:02.599642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ae78d1c9-00d2-4e76-a195-971d85e24992 req-5ea38986-07f4-4244-8f8f-d4346d36482d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:02.600194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ae78d1c9-00d2-4e76-a195-971d85e24992 req-5ea38986-07f4-4244-8f8f-d4346d36482d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:02.619618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-ae78d1c9-00d2-4e76-a195-971d85e24992 req-5ea38986-07f4-4244-8f8f-d4346d36482d service nova] Creating event network-vif-plugged:db4f9a30-49b2-423e-8440-422993fe5bf7 for instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f on hv-cinder-84984 Jul 19 15:31:02.625719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-ae78d1c9-00d2-4e76-a195-971d85e24992 req-5ea38986-07f4-4244-8f8f-d4346d36482d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144462 Jul 19 15:31:02.632210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 22/40] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:02.638851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:02.639764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:02.646629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:02.647277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:02.648375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:02.649821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:03.355683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:03.384250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ebffa00c-b205-4e1e-9ee5-5a3725beb8cf tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.925305 Jul 19 15:31:03.385341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 19/41] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:02 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:03.395288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:03.413279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:03.423136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:03.433692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ddde9079-8ad6-4feb-b2d8-1e02998db2b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.794395 Jul 19 15:31:03.446275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 23/42] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:02 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:03.464280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:03.465383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:03.472258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:03.473225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:03.474294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:03.474943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:03.713172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-0a982fa4-db39-459f-b7a9-67b441aba57d req-62411cdf-dfe1-4e84-9f2c-492cc54d3d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:03.721471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0a982fa4-db39-459f-b7a9-67b441aba57d req-62411cdf-dfe1-4e84-9f2c-492cc54d3d31 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:03.722135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0a982fa4-db39-459f-b7a9-67b441aba57d req-62411cdf-dfe1-4e84-9f2c-492cc54d3d31 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:03.733894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-0a982fa4-db39-459f-b7a9-67b441aba57d req-62411cdf-dfe1-4e84-9f2c-492cc54d3d31 service nova] Creating event network-changed:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:31:03.739268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-0a982fa4-db39-459f-b7a9-67b441aba57d req-62411cdf-dfe1-4e84-9f2c-492cc54d3d31 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345940 Jul 19 15:31:03.740375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 20/43] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:03.747146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:03.748320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:03.756630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:03.757358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:03.760721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:03.774741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:04.107301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.116183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-30ccb1ac-dfc2-4a7e-a61b-e1699686b4e4 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.657420 Jul 19 15:31:04.116767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 24/44] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:03 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:04.362008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.370718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39f35dff-be45-4cc6-8715-593d2dcad1d7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.628962 Jul 19 15:31:04.371305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 21/45] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:03 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:04.405764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:04.406838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:04.415463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:04.416101 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:04.417167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:04.417735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:04.457115 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:04.459720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:04.478758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:04.479394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:04.480170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:04.480616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:04.858285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.873029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-33a220fa-ca19-4fbe-9e93-ec543c9a3bf9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.470238 Jul 19 15:31:04.873922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 25/46] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:04 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:04.903631 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.912696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.915040 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:04.916389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ae606c0a-4940-46b3-8a74-d4a4fb30f515 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.466955 Jul 19 15:31:04.916970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 22/47] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:04 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:05.135444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:05.136058 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:05.144677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.145132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.150907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.151368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.389587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:05.390551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:05.398885 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.400048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.401419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.402415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.408468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:05.416548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8d711d00-6fb8-46ef-a55b-52f7171a2b28 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1315 microversion: 2.1 time: 0.285450 Jul 19 15:31:05.417131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 26/48] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:05 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:05.628831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:05.637305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bb4f0402-d50d-43a5-b9b8-83ec4ea7c9b5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.253877 Jul 19 15:31:05.638252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 23/49] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:05 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:05.775261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-bb8f90a8-ea69-4757-8555-85812ef91ef2 req-f63dfd9b-a966-418f-8efc-672be768025e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d78f8e2-17a7-4eb3-852f-369ee03e3630", "tag": "8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:05.785401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-bb8f90a8-ea69-4757-8555-85812ef91ef2 req-f63dfd9b-a966-418f-8efc-672be768025e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.785846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-bb8f90a8-ea69-4757-8555-85812ef91ef2 req-f63dfd9b-a966-418f-8efc-672be768025e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.798098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-bb8f90a8-ea69-4757-8555-85812ef91ef2 req-f63dfd9b-a966-418f-8efc-672be768025e service nova] Creating event network-changed:8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6 for instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 on hv-cinder-84984 Jul 19 15:31:05.803474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-bb8f90a8-ea69-4757-8555-85812ef91ef2 req-f63dfd9b-a966-418f-8efc-672be768025e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033243 Jul 19 15:31:05.804072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 27/50] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:05.893737 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:05.902101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:05.916188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.917794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.919088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.921018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.936368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:05.937756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:05.944954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.945437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:05.946212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:05.946643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:06.069413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:06.159590 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:06.164124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:06.168116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-df3e2b79-123e-422f-91a0-02daaa521c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.279746 Jul 19 15:31:06.168687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:05 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:06.177718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:06.179386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:06.180622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-64f2b512-f1e9-43a4-ab2f-615bd9f213e3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.248794 Jul 19 15:31:06.181202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 28/52] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:05 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:31:06.434566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:06.435808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:06.445160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:06.446476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:06.447572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:06.448315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:06.656062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:06.656677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:06.658908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=10 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:06.668915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:06.668915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:06.668915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:06.668915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:06.925672 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=14 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:07.054446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.063828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0b17be83-0766-4bcb-9649-f3e008db8c4c tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1501 microversion: 2.1 time: 0.633739 Jul 19 15:31:07.086475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 25/53] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:06 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1501 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:07.127030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.144526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e8d8c93b-a01d-48b0-88b2-37e11e13cce6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.492187 Jul 19 15:31:07.145916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:06 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:07.186439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:07.187160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:07.194629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:07.195082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:07.196778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:07.196968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:07.204623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:07.205364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:07.229675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:07.230127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:07.230906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:07.231339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:07.476184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.488609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dc7f4483-e9b8-4d97-8762-663eb9b1c96b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.306285 Jul 19 15:31:07.491295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 26/55] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:07 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:07.498414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-239d5843-af96-46a0-a326-3796874c9ba5 req-7a08840b-fa86-494e-a1df-6091a72a8e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6448684-07a9-4238-bcd7-8b1f4620d268", "name": "network-vif-plugged", "status": "completed", "tag": "8be689cb-9892-4bb4-bab2-3ee46f50f000"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:07.527214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-239d5843-af96-46a0-a326-3796874c9ba5 req-7a08840b-fa86-494e-a1df-6091a72a8e40 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:07.528350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-239d5843-af96-46a0-a326-3796874c9ba5 req-7a08840b-fa86-494e-a1df-6091a72a8e40 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:07.557272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-239d5843-af96-46a0-a326-3796874c9ba5 req-7a08840b-fa86-494e-a1df-6091a72a8e40 service nova] Creating event network-vif-plugged:8be689cb-9892-4bb4-bab2-3ee46f50f000 for instance a6448684-07a9-4238-bcd7-8b1f4620d268 on hv-cinder-84984 Jul 19 15:31:07.571199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.574499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-239d5843-af96-46a0-a326-3796874c9ba5 req-7a08840b-fa86-494e-a1df-6091a72a8e40 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079525 Jul 19 15:31:07.576094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 27/56] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:07.576688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:07.594136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.600826 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:07.601386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-db357d3d-8770-4be6-a592-c93886c7cc40 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.405899 Jul 19 15:31:07.603784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:07 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:08.163470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:08.164694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:08.182332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.183612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.184583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.192797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.224012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:08.457193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:08.484913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-10dfa496-304c-4b81-acd0-c1f80b6cd52f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1361 microversion: 2.1 time: 0.325890 Jul 19 15:31:08.485890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 28/58] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:08 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:08.507840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:08.509387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:08.516804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.517478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.518493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.519162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.622479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:08.623142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:08.635211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.635776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.636553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.636984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.867888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:08.868370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:08.877188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:08.877632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f6fefba2-713d-4b26-ad9c-d578de4dbd98 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.374861 Jul 19 15:31:08.878755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:08.879938 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f5440f7a-5c28-47b8-95bf-2432c0aa137d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.261465 Jul 19 15:31:08.880490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 29/59] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:08 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:08.888716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 31/60] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:08 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:08.895471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be023322-78e5-44a4-87e6-b78ca681cafa"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:08.897063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:08.905547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.905991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:08.907307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:08.907746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.506220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:09.507290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:09.555593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.557128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.558219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.558988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.604002 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ae22bbab-4b7e-47c2-9909-47cf8dc836c0 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "POST /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.715676 Jul 19 15:31:09.605704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:31:08 2022] POST /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:09.787891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:09.800973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e383a86a-4445-4cd4-b787-598c82c355f1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1546 microversion: 2.1 time: 0.302460 Jul 19 15:31:09.807836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 32/62] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:09 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1546 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:09.837132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:09.837928 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:09.862480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.863237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.868546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.868546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.895014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:09.895915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:09.905163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.907751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:09.908495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:09.917462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:10.064660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0fbdbf96-eec0-4cbc-b6ae-030526f54719 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.242841 Jul 19 15:31:10.065774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:31:09 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:10.071934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:10.072718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:10.081126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:10.081773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:10.083425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:10.084136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:10.444334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:10.454697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f2b82dff-842a-4f74-95b8-76b945e3a79f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.563554 Jul 19 15:31:10.464659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 33/64] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:09 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:10.541432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:10.554056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:10.556831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:10.558195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d1cf0b0c-e210-41b9-ae62-e663f7ff9f39 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.491346 Jul 19 15:31:10.558840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:10 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:11.471562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:11.472732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:11.479342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:11.479785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:11.480543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:11.481192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:11.576303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:11.577191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:11.590008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:11.592488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:11.593363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:11.594387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:11.596260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:11.756477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:11.765604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bb9f1cda-d7e4-4f7e-bdc1-e07329ca96f9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.297741 Jul 19 15:31:11.776291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:11 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:11.906185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:11.915469 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-99b617ef-c924-4b52-8647-ffc83bf055e4 req-62858cac-cb20-4eb6-9b34-e8667912f5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6448684-07a9-4238-bcd7-8b1f4620d268", "tag": "8be689cb-9892-4bb4-bab2-3ee46f50f000"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:11.916900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:11.918447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:11.919793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-caab139d-2f06-4e7e-955b-cf16630c2cf1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.347585 Jul 19 15:31:11.920370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:11 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:11.925758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-99b617ef-c924-4b52-8647-ffc83bf055e4 req-62858cac-cb20-4eb6-9b34-e8667912f5f2 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:11.926285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-99b617ef-c924-4b52-8647-ffc83bf055e4 req-62858cac-cb20-4eb6-9b34-e8667912f5f2 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:11.939367 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-99b617ef-c924-4b52-8647-ffc83bf055e4 req-62858cac-cb20-4eb6-9b34-e8667912f5f2 service nova] Creating event network-changed:8be689cb-9892-4bb4-bab2-3ee46f50f000 for instance a6448684-07a9-4238-bcd7-8b1f4620d268 on hv-cinder-84984 Jul 19 15:31:11.944639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-99b617ef-c924-4b52-8647-ffc83bf055e4 req-62858cac-cb20-4eb6-9b34-e8667912f5f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034427 Jul 19 15:31:11.945233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 35/68] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:31:12.783174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:12.783781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:12.790313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:12.790757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:12.791511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:12.791942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:12.930839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:12.938318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1fbaf031-ffb7-490c-967e-cae6a2f09125 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.158926 Jul 19 15:31:12.938825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:12.939315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 34/69] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:12 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:12.940166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:12.950721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:12.951170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:12.952206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:12.952367 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:13.089671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:13.097890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:13.099393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:13.100547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-40340216-a7b4-404a-8c5e-56a542d008b4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.165950 Jul 19 15:31:13.101107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:12 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:31:13.926295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-47ed8e54-81aa-47f8-b682-1ebc2777dfbb req-0bad243b-c9b0-4669-b552-b15a95a9d3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "name": "network-vif-plugged", "status": "completed", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:13.946160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-47ed8e54-81aa-47f8-b682-1ebc2777dfbb req-0bad243b-c9b0-4669-b552-b15a95a9d3c0 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:13.946973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-47ed8e54-81aa-47f8-b682-1ebc2777dfbb req-0bad243b-c9b0-4669-b552-b15a95a9d3c0 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:13.954974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:13.956140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:13.965973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:13.966423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:13.967190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:13.967627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:13.982920 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-47ed8e54-81aa-47f8-b682-1ebc2777dfbb req-0bad243b-c9b0-4669-b552-b15a95a9d3c0 service nova] Creating event network-vif-plugged:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:31:13.999691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-47ed8e54-81aa-47f8-b682-1ebc2777dfbb req-0bad243b-c9b0-4669-b552-b15a95a9d3c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078092 Jul 19 15:31:14.005287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 35/71] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:14.120590 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:14.121571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:14.127965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:14.128444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:14.129235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:14.129669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:14.131407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:14.139529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4f62b186-fb23-4898-851b-e290e30951da tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.188504 Jul 19 15:31:14.140096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:13 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:14.264526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:14.272385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:14.275623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:14.276730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0c9dd1f0-f4a3-4387-b9e7-52565443a4ce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.161866 Jul 19 15:31:14.277298 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 36/73] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:14 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:15.157343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:15.158003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:15.164749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:15.165211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:15.165968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:15.166399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:15.294959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:15.295571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:15.296137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:15.302322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:15.302774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:15.303552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:15.303677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4e880267-2aad-458b-bed7-f93f1b2f8e99 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.150272 Jul 19 15:31:15.303990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:15.304895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:15 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:15.433913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:15.441638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:15.443141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:15.444229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d19721f1-29f7-4a8e-b019-1213756557aa tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.153068 Jul 19 15:31:15.444785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 37/75] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:15 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:16.321274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:16.321808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:16.327818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:16.328257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:16.329005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:16.329495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:16.461068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:16.463567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:16.464244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:16.469008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b50fc8d5-fe38-4bcd-8ae9-7caf756624c3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.151692 Jul 19 15:31:16.469627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 39/76] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:16 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:16.470749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:16.471190 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:16.471946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:16.472377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:16.644577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:16.654427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:16.667181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:16.668451 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b74e7152-1f1a-4d45-9f4f-0d5f1d6320bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.209195 Jul 19 15:31:16.673067 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 38/77] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:16 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:31:17.250296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-05eedb09-97b1-4d18-8020-abb51bcaf746 req-21485e1a-90bb-45e1-b69e-5cfe43bc1017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d78f8e2-17a7-4eb3-852f-369ee03e3630", "name": "network-vif-plugged", "status": "completed", "tag": "8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:17.279017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-05eedb09-97b1-4d18-8020-abb51bcaf746 req-21485e1a-90bb-45e1-b69e-5cfe43bc1017 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:17.281094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-05eedb09-97b1-4d18-8020-abb51bcaf746 req-21485e1a-90bb-45e1-b69e-5cfe43bc1017 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:17.297620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-05eedb09-97b1-4d18-8020-abb51bcaf746 req-21485e1a-90bb-45e1-b69e-5cfe43bc1017 service nova] Creating event network-vif-plugged:8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6 for instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 on hv-cinder-84984 Jul 19 15:31:17.303448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-05eedb09-97b1-4d18-8020-abb51bcaf746 req-21485e1a-90bb-45e1-b69e-5cfe43bc1017 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057788 Jul 19 15:31:17.305044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 40/78] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:17.487077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:17.494683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:17.504803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:17.505574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:17.506562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:17.507099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:17.666633 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:17.675736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a05606c8-fbd9-492e-81c1-15ec2784f15c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.193037 Jul 19 15:31:17.676569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 39/79] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:17 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:17.689753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:17.690453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:17.711501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:17.712055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:17.712973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:17.714412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:17.992680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:18.000937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:18.003241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:18.004639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e0860cf4-f79f-432f-8cc9-13a9feca9a5c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1405 microversion: 2.20 time: 0.321897 Jul 19 15:31:18.005498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 41/80] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:17 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1405 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:18.693107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:18.693664 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:18.700337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:18.700864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:18.701660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:18.702252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:18.873085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:18.882077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-59efebfe-e6d4-4483-bed9-733ac9cf9774 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.192835 Jul 19 15:31:18.883018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:18 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:19.024795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:19.025295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:19.031377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.031814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:19.032774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.033400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:19.189079 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:19.200846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:19.205960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:19.208663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8307ff4c-c689-4ddf-a9a3-66f3b3e97b79 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1597 microversion: 2.20 time: 0.189461 Jul 19 15:31:19.209583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 42/82] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:31:19 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1597 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:31:19.227986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:19.228717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:19.242537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:19.244486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.244944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:19.246057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.246679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:19.347124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-70fdaab4-08c1-414f-877f-e8e02bd2826a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.123623 Jul 19 15:31:19.348502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 41/83] 10.222.0.42 () {60 vars in 1315 bytes} [Tue Jul 19 15:31:19 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:31:19.899274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:19.901584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:19.908846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.909653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:19.911353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:19.912100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:20.116225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:20.125489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bf1a5287-c994-4035-92d2-36c76d3baf0c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1367 microversion: 2.1 time: 0.230375 Jul 19 15:31:20.130223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:19 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:20.921122 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-bfb8a13a-06d7-497b-a5a0-9f2fe1cdb553 req-d5159e02-bef5-484a-8296-25ef5e37af5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:20.933472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-bfb8a13a-06d7-497b-a5a0-9f2fe1cdb553 req-d5159e02-bef5-484a-8296-25ef5e37af5a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:20.933911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-bfb8a13a-06d7-497b-a5a0-9f2fe1cdb553 req-d5159e02-bef5-484a-8296-25ef5e37af5a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:20.946274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-bfb8a13a-06d7-497b-a5a0-9f2fe1cdb553 req-d5159e02-bef5-484a-8296-25ef5e37af5a service nova] Creating event network-changed:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:31:20.951828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-bfb8a13a-06d7-497b-a5a0-9f2fe1cdb553 req-d5159e02-bef5-484a-8296-25ef5e37af5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035067 Jul 19 15:31:20.956164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 42/85] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:21.147733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:21.148814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:21.156025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:21.156472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:21.157269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:21.157716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:21.291789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:21.299322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-872453d0-fe6d-451c-911f-772afb33cd76 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1556 microversion: 2.1 time: 0.157027 Jul 19 15:31:21.299886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 44/86] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:21 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:21.318427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:21.319177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:21.326030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:21.326549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:21.327374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:21.327876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:21.412827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d218ce75-6bb3-4fb5-9bcd-3444b3556bec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098869 Jul 19 15:31:21.414049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:31:21 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:22.702658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-e7aebf77-2cbb-4301-a290-32ebccb754c2 req-f8e0af74-f5fa-48a2-b2c8-8b074fc30f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d78f8e2-17a7-4eb3-852f-369ee03e3630", "tag": "8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:22.714220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e7aebf77-2cbb-4301-a290-32ebccb754c2 req-f8e0af74-f5fa-48a2-b2c8-8b074fc30f17 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:22.714671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e7aebf77-2cbb-4301-a290-32ebccb754c2 req-f8e0af74-f5fa-48a2-b2c8-8b074fc30f17 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:22.736929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-e7aebf77-2cbb-4301-a290-32ebccb754c2 req-f8e0af74-f5fa-48a2-b2c8-8b074fc30f17 service nova] Creating event network-changed:8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6 for instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 on hv-cinder-84984 Jul 19 15:31:22.743030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-e7aebf77-2cbb-4301-a290-32ebccb754c2 req-f8e0af74-f5fa-48a2-b2c8-8b074fc30f17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043684 Jul 19 15:31:22.743876 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 45/88] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:31:26.060449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:26.061025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:26.072872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:26.073901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:26.074724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:26.075167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:26.125321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:31:26.183840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.242340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fb943226-90ac-402e-bc7f-b6249e345ab3 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 204 len: 0 microversion: 2.1 time: 0.185214 Jul 19 15:31:26.243476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:31:26 2022] DELETE /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:31:26.262755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:26.263451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:26.268564 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:26.271273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:26.271941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:26.273401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:26.274066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:26.459912 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:26.471704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-865860a8-38f0-4b93-9408-b060e29b5aec tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.213467 Jul 19 15:31:26.472550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 46/90] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:26 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:27.497200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:27.499013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:27.507586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:27.508227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:27.509013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:27.510015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:27.656714 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:27.671174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-01faf542-a44e-40b3-9af4-784ee911317d tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.179907 Jul 19 15:31:27.671765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:27 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:28.688407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:28.689004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:28.695159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:28.695604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:28.696712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:28.696819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:28.825476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:28.833320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-af1c551a-e53e-4fdc-8b30-553a4d903d33 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.148796 Jul 19 15:31:28.833885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 47/92] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:28 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:29.850102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:29.850707 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:29.857186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:29.857631 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:29.858379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:29.858809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:29.996493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:30.004376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-105b2c5b-1d24-4dc6-908d-fcbed7e1da58 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.158137 Jul 19 15:31:30.004936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 46/93] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:29 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:31.021998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:31.022722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:31.029128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:31.029593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:31.030536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:31.030969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:31.165039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:31.174091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8dc8af52-3e77-4f1b-90c7-2aadc2293999 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.155879 Jul 19 15:31:31.174919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 48/94] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:31 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:32.194969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:32.195568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:32.202239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:32.202433 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:32.203192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:32.203622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:32.333625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:32.341587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-642f29d1-9271-4489-b77a-4a49999fc878 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.150915 Jul 19 15:31:32.342159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 47/95] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:32 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:33.358869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:33.360009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:33.387466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:33.388592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:33.389515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:33.389960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:33.411112 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:33.614501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:33.628529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d8aeaf3b-96c5-442f-b384-d7ac1e24cdcb tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1553 microversion: 2.1 time: 0.273510 Jul 19 15:31:33.641197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 49/96] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:33 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:33.701464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-8d8d3222-8a80-4a48-b978-e7332a2d7c42 req-0415e8c3-4513-4a1a-bc1a-29e0045d5bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f", "name": "network-vif-deleted", "tag": "db4f9a30-49b2-423e-8440-422993fe5bf7"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:33.713980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8d8d3222-8a80-4a48-b978-e7332a2d7c42 req-0415e8c3-4513-4a1a-bc1a-29e0045d5bf6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:33.714532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8d8d3222-8a80-4a48-b978-e7332a2d7c42 req-0415e8c3-4513-4a1a-bc1a-29e0045d5bf6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:33.728385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-8d8d3222-8a80-4a48-b978-e7332a2d7c42 req-0415e8c3-4513-4a1a-bc1a-29e0045d5bf6 service nova] Creating event network-vif-deleted:db4f9a30-49b2-423e-8440-422993fe5bf7 for instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f on hv-cinder-84984 Jul 19 15:31:33.741080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-8d8d3222-8a80-4a48-b978-e7332a2d7c42 req-0415e8c3-4513-4a1a-bc1a-29e0045d5bf6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043437 Jul 19 15:31:33.743656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 48/97] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:34.647646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:34.648549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:34.665545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:34.666184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:34.666977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:34.667421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:34.703198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:34.703830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:34.704499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lazy-loading 'fault' on Instance uuid e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:31:34.766806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '064d7bbcf3684ccbafc5f3d1cb561d9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2deb7182f86846e09269b7cba6fab758', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:34.777719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8cf18f6d-10a0-4949-88fb-be5413c4e403 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 200 len: 1351 microversion: 2.1 time: 0.134528 Jul 19 15:31:34.790153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 50/98] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:34 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 1351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:35.796086 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:35.796775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:35.802926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:35.803387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:35.805464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:35.805907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:35.819049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] HTTP exception thrown: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Request method failure captured: Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f HTTP/1.1 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4TD1Zuzu0VJlRDA21az2xV28kepnAPZ0Hy91OMBC0SYfOGMyHNOumrWuGowkXaM0UcmseaTTB88APW8iN6_gnh3r7YvEFE1OdadKZFwIHpWMdRELd1SyLbvy_RbqUPwhtbxo0tMzv-OWvG0uGT0RgnqMMUPC-nb18OXTwstSAmZ9U Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:31:35.824133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2deb7182f86846e09269b7cba6fab758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2deb7182f86846e09269b7cba6fab758"}]}] Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 064d7bbcf3684ccbafc5f3d1cb561d9a Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:35.825377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f'} Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:31:35.826061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:35.827250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:35.828262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Returning 404 to user: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:31:35.828262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a689efd7-605a-4b81-9a46-0008cf568463 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 404 len: 111 microversion: 2.1 time: 0.034177 Jul 19 15:31:35.828262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 49/99] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:35 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:31:35.934005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:35.936561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:35.956451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:35.957063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:35.957873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:35.958313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:36.011370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] HTTP exception thrown: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Request method failure captured: Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f/os-volume_attachments HTTP/1.1 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4TD1Zuzu0VJlRDA21az2xV28kepnAPZ0Hy91OMBC0SYfOGMyHNOumrWuGowkXaM0UcmseaTTB88APW8iN6_gnh3r7YvEFE1OdadKZFwIHpWMdRELd1SyLbvy_RbqUPwhtbxo0tMzv-OWvG0uGT0RgnqMMUPC-nb18OXTwstSAmZ9U Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:31:36.018485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2deb7182f86846e09269b7cba6fab758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2deb7182f86846e09269b7cba6fab758"}]}] Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 064d7bbcf3684ccbafc5f3d1cb561d9a Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:36.019724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'server_id': 'e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f'} Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:31:36.020421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:36.021524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:36.023147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Returning 404 to user: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:31:36.023147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-23d7e9d2-df44-44c6-a334-5834d412da22 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.092396 Jul 19 15:31:36.023147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 51/100] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:31:35 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:31:37.236892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:37.237721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:37.244548 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:37.244988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:37.245960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:37.246386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:37.261808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] HTTP exception thrown: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Request method failure captured: Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: DELETE /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f HTTP/1.1 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4TD1Zuzu0VJlRDA21az2xV28kepnAPZ0Hy91OMBC0SYfOGMyHNOumrWuGowkXaM0UcmseaTTB88APW8iN6_gnh3r7YvEFE1OdadKZFwIHpWMdRELd1SyLbvy_RbqUPwhtbxo0tMzv-OWvG0uGT0RgnqMMUPC-nb18OXTwstSAmZ9U Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:31:37.263326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2deb7182f86846e09269b7cba6fab758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2deb7182f86846e09269b7cba6fab758"}]}] Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 064d7bbcf3684ccbafc5f3d1cb561d9a Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.264549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f'} Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:31:37.265232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.266327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.267355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Returning 404 to user: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:31:37.267355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7d0764f3-11ff-49fd-9181-c92d1c09d325 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 404 len: 111 microversion: 2.1 time: 0.031817 Jul 19 15:31:37.267355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:31:37 2022] DELETE /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:31:37.274074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:37.274933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] [instance: e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:37.282279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:37.282734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:37.283536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:37.283974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:37.297379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] HTTP exception thrown: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Request method failure captured: Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f HTTP/1.1 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4TD1Zuzu0VJlRDA21az2xV28kepnAPZ0Hy91OMBC0SYfOGMyHNOumrWuGowkXaM0UcmseaTTB88APW8iN6_gnh3r7YvEFE1OdadKZFwIHpWMdRELd1SyLbvy_RbqUPwhtbxo0tMzv-OWvG0uGT0RgnqMMUPC-nb18OXTwstSAmZ9U Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:31:37.299574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2deb7182f86846e09269b7cba6fab758"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2deb7182f86846e09269b7cba6fab758"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2deb7182f86846e09269b7cba6fab758"}]}] Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 2deb7182f86846e09269b7cba6fab758 Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-DeleteServersTestJSON-1084001955 Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 064d7bbcf3684ccbafc5f3d1cb561d9a Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-DeleteServersTestJSON-1084001955-project Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.301120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f'} Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:31:37.301973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. Jul 19 15:31:37.303236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:31:37.304511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] Returning 404 to user: Instance e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:31:37.304511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-52262c50-57ee-4e8e-b654-a7ee56303ac7 tempest-DeleteServersTestJSON-1084001955 tempest-DeleteServersTestJSON-1084001955-project] 10.222.0.42 "GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f" status: 404 len: 111 microversion: 2.1 time: 0.031492 Jul 19 15:31:37.304511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 52/102] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:37 2022] GET /compute/v2.1/servers/e0d46fa1-f0a4-4443-be45-b6a2f11a2a2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:31:48.440350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.441115 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:48.606091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2067349535", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:48.695217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] validate_networks() for [('64a3dd77-0154-437f-a110-1bf7cbe9008a', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:31:49.267074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:31:49.269517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:31:49.270129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:31:49.273220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:31:49.275293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:31:49.288398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:49.288861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:49.289740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:49.290173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:49.306957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:31:49.312361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for user 491d052f3d2947cea318b0753fffd1fa and project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:31:49.329805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:31:49.332062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:31:49.386877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ed320f03-eba3-49cf-bd73-97bd509a1be5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.957583 Jul 19 15:31:49.387734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 51/103] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:31:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:31:49.400368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9e046b19-9a20-4274-b3aa-f3329ec468ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:49.401684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9e046b19-9a20-4274-b3aa-f3329ec468ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:49.405660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=15 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:49.406508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=14 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:49.583344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9e046b19-9a20-4274-b3aa-f3329ec468ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:49.604501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9e046b19-9a20-4274-b3aa-f3329ec468ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1222 microversion: 2.1 time: 0.209831 Jul 19 15:31:49.609662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:49 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1222 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:49.699408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1849109213", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:49.891116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] validate_networks() for [('64a3dd77-0154-437f-a110-1bf7cbe9008a', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:31:50.812907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:31:50.813649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:31:50.814006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:31:50.814478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:31:50.814960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:31:50.832546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:50.833999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:50.835191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:50.836395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:50.855244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:31:50.862191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for user 491d052f3d2947cea318b0753fffd1fa and project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:31:50.875025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:31:50.877454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:31:50.933766 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-68b9261b-be1f-4664-bf4b-92bfce714722 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.237564 Jul 19 15:31:50.935367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 52/105] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:31:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:31:50.948616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1b92117e-fad2-4dc8-baef-a0660fa11712 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:50.950466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1b92117e-fad2-4dc8-baef-a0660fa11712 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:51.109122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1b92117e-fad2-4dc8-baef-a0660fa11712 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:51.122496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1b92117e-fad2-4dc8-baef-a0660fa11712 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1222 microversion: 2.1 time: 0.179532 Jul 19 15:31:51.124166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 54/106] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:50 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:31:52.140006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:52.140683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:52.155256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:52.155710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:52.156556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:52.156927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:52.320350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:52.330687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e4fc5409-f0bd-4277-8ab5-a3b280cb1475 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1226 microversion: 2.1 time: 0.193945 Jul 19 15:31:52.336038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 53/107] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:52 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:53.350517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:53.351187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:53.360248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:53.360706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:53.366525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:53.366745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:53.471977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:53.484374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4fef81c0-e180-4a1a-a9ed-aca741c73410 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1226 microversion: 2.1 time: 0.137933 Jul 19 15:31:53.485512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 55/108] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:53 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:54.501084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:54.502011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:54.509779 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:54.510815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:54.512342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:54.513095 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:54.629554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:54.640030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b152ff9b-1aae-4f7a-97f2-3911a6b35234 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1274 microversion: 2.1 time: 0.142770 Jul 19 15:31:54.641264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 54/109] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:54 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1274 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:55.064495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-6fb3be20-0c63-4e50-b7bb-cf88f8bfd058 req-e8354347-69e3-44f9-a5eb-11f67546b5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "751332f2-549d-4fc4-91f6-7c217bb044c4", "tag": "2e2bf763-ea09-45dd-b98f-bb8d3f177ddc"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:31:55.092415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-6fb3be20-0c63-4e50-b7bb-cf88f8bfd058 req-e8354347-69e3-44f9-a5eb-11f67546b5d2 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:55.093094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-6fb3be20-0c63-4e50-b7bb-cf88f8bfd058 req-e8354347-69e3-44f9-a5eb-11f67546b5d2 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:55.132935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-6fb3be20-0c63-4e50-b7bb-cf88f8bfd058 req-e8354347-69e3-44f9-a5eb-11f67546b5d2 service nova] Creating event network-changed:2e2bf763-ea09-45dd-b98f-bb8d3f177ddc for instance 751332f2-549d-4fc4-91f6-7c217bb044c4 on hv-cinder-84984 Jul 19 15:31:55.142827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-6fb3be20-0c63-4e50-b7bb-cf88f8bfd058 req-e8354347-69e3-44f9-a5eb-11f67546b5d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082993 Jul 19 15:31:55.143436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 56/110] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:31:55.658896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:55.659673 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:55.673648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:55.674200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:55.674898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:55.683676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:55.852970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:55.864945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f365f5fc-d4c9-41c4-9f08-c24044c333e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1280 microversion: 2.1 time: 0.210164 Jul 19 15:31:55.869646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 55/111] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:55 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:56.887143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:56.887842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:56.894085 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:56.894537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:56.895305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:56.895769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:57.027917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:57.035414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4819777e-515f-4128-b41c-7c8cce6939aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.152477 Jul 19 15:31:57.035971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 57/112] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:56 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:58.051846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:58.053019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:58.059469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:58.059913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:58.060670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:58.061101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:58.189756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:58.199011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9fc3444d-630a-4e55-ab22-1d46ae8f36b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.151118 Jul 19 15:31:58.199585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 56/113] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:58 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:31:59.216690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:31:59.216690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:31:59.222334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:59.222782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:59.223540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:31:59.223976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:31:59.354301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:31:59.361568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c2071e64-d3a7-4465-aae8-65b96aaa1097 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.149930 Jul 19 15:31:59.362131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 58/114] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:31:59 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:00.379780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:00.382016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:00.419790 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:00.420513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:00.422956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:00.424551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:00.645965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-02e7fdfd-f0eb-4e8a-8b20-4524aa40e41e req-8c0edb1b-c5d1-447e-8521-1584b9bcd546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07929d52-360d-4bb4-99bf-aef1e30a9b6f", "tag": "88c26c43-7e3b-4397-9280-7b9db97e3cc5"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:00.668240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-02e7fdfd-f0eb-4e8a-8b20-4524aa40e41e req-8c0edb1b-c5d1-447e-8521-1584b9bcd546 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:00.669166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-02e7fdfd-f0eb-4e8a-8b20-4524aa40e41e req-8c0edb1b-c5d1-447e-8521-1584b9bcd546 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:00.700093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-02e7fdfd-f0eb-4e8a-8b20-4524aa40e41e req-8c0edb1b-c5d1-447e-8521-1584b9bcd546 service nova] Creating event network-changed:88c26c43-7e3b-4397-9280-7b9db97e3cc5 for instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f on hv-cinder-84984 Jul 19 15:32:00.713750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-02e7fdfd-f0eb-4e8a-8b20-4524aa40e41e req-8c0edb1b-c5d1-447e-8521-1584b9bcd546 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071483 Jul 19 15:32:00.717211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 59/115] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:32:00.804754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:00.818978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c5bd2a33-76ae-474f-a3e0-80a209a9d960 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.442197 Jul 19 15:32:00.820374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 57/116] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:00 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:01.836081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:01.836765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:01.838699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:01.844690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:01.845194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:01.845989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:01.846425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:01.975740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:01.983096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-276b1784-f950-4ee3-91e5-e6b8aa930360 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.151195 Jul 19 15:32:01.983657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 60/117] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:01 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:03.000215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:03.000825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:03.002736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=4 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:03.003389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=12 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:03.009620 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:03.010072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:03.010836 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:03.011275 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:03.144098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:03.152317 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-53cb67ec-661a-41cc-bec8-56c017fe05cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.155888 Jul 19 15:32:03.152912 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 58/118] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:02 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:04.171014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:04.171620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:04.180299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:04.180742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:04.181539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:04.181971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:04.328907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:04.336630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-469b9f47-2d40-4b3a-8a31-a062c43fade3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.171374 Jul 19 15:32:04.337209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 61/119] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:04 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:05.353260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:05.353866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:05.360321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:05.360762 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:05.361553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:05.361989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:05.496886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:05.505882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-def55292-64a4-407f-a75e-862b4cd7aadf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.155823 Jul 19 15:32:05.506716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 59/120] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:05 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:06.523561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:06.524331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:06.530351 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:06.530788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:06.531537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:06.531970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:06.667345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:06.674701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4ad71f5a-3f48-4c80-9468-bdc6f1035296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.155646 Jul 19 15:32:06.675277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 62/121] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:06 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:07.087043 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:07.087527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:07.094024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:07.094467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:07.095227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:07.095654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:07.118896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f0d674b4-f877-44c2-9b04-04c90f97b9d9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/ips" status: 200 len: 145 microversion: 2.1 time: 0.035654 Jul 19 15:32:07.119461 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 60/122] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:32:07 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:07.692187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:07.692815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:07.698947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:07.699388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:07.700137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:07.700563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:07.825554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:07.832849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7cb68554-2b32-4aab-bbda-1c60a38f89b2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.144439 Jul 19 15:32:07.834069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 63/123] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:07 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:08.850660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:08.851258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:08.857630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:08.858075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:08.858841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:08.859273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:08.988939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:08.996368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ba6990c5-0be2-44f2-bf6c-f2d7f43b2058 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.150121 Jul 19 15:32:08.996932 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 61/124] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:08 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:10.013572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:10.014177 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:10.020546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:10.021411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:10.022294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:10.022808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:10.159730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:10.170117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8a6256c0-1159-4b85-b458-441a30f16a41 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.160222 Jul 19 15:32:10.171136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 64/125] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:10 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:10.352313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3feb7686-bb3d-4196-822f-fb727758f50f"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:10.357514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:10.364679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-7fac6d52-834e-4560-beab-a7843313da67 req-8e76e4ea-414c-45b8-98d5-66c6d0b9db5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751332f2-549d-4fc4-91f6-7c217bb044c4", "name": "network-vif-plugged", "status": "completed", "tag": "2e2bf763-ea09-45dd-b98f-bb8d3f177ddc"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:10.379412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-7fac6d52-834e-4560-beab-a7843313da67 req-8e76e4ea-414c-45b8-98d5-66c6d0b9db5a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:10.380766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-7fac6d52-834e-4560-beab-a7843313da67 req-8e76e4ea-414c-45b8-98d5-66c6d0b9db5a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:10.386921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:10.391173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:10.392234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:10.392856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:10.400850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-7fac6d52-834e-4560-beab-a7843313da67 req-8e76e4ea-414c-45b8-98d5-66c6d0b9db5a service nova] Creating event network-vif-plugged:2e2bf763-ea09-45dd-b98f-bb8d3f177ddc for instance 751332f2-549d-4fc4-91f6-7c217bb044c4 on hv-cinder-84984 Jul 19 15:32:10.407316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-7fac6d52-834e-4560-beab-a7843313da67 req-8e76e4ea-414c-45b8-98d5-66c6d0b9db5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049926 Jul 19 15:32:10.408224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 65/126] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:10.828201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7727e010-456a-45fd-8aa6-ae8cb9c69f64 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485155 Jul 19 15:32:10.836186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 62/127] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:32:10 2022] POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:32:11.189077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:11.189800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:11.196485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:11.196930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:11.197730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:11.198171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:11.378569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:11.386659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c0db9b43-abd9-4e0a-a553-c517a7e9626c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.203122 Jul 19 15:32:11.387648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:11 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:12.406316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:12.407338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:12.414789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:12.415202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:12.415989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:12.416428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:12.577705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:12.587692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-87f2039d-afea-49c0-84cf-b116c82c67b1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.186434 Jul 19 15:32:12.593246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 63/129] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:12 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:13.605801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:13.606411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:13.612543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:13.613065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:13.613767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:13.614203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:13.753117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:13.760756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c453df9f-4f0f-4b25-9d62-3333fb789b81 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.158739 Jul 19 15:32:13.766265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 67/130] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:13 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:14.777823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:14.778437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:14.785030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:14.785523 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:14.786376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:14.786813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:14.918782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:14.926044 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4e10ccf7-7c8a-4e32-9ffc-b476332d3ed4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.152397 Jul 19 15:32:14.926595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 64/131] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:14 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:15.943008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:15.944126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:15.949991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:15.950434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:15.951189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:15.951618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:16.122599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:16.131917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-96846b76-d086-482e-ab1f-cbf58406d8ad tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.193220 Jul 19 15:32:16.132673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 68/132] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:15 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:16.893256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-5691c4af-72a3-4a54-8d1e-7fb75a989df2 req-e2812eb3-af09-4c4e-9328-fc758f2e0a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07929d52-360d-4bb4-99bf-aef1e30a9b6f", "name": "network-vif-plugged", "status": "completed", "tag": "88c26c43-7e3b-4397-9280-7b9db97e3cc5"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:16.909228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5691c4af-72a3-4a54-8d1e-7fb75a989df2 req-e2812eb3-af09-4c4e-9328-fc758f2e0a03 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:16.910172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5691c4af-72a3-4a54-8d1e-7fb75a989df2 req-e2812eb3-af09-4c4e-9328-fc758f2e0a03 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:16.931155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-5691c4af-72a3-4a54-8d1e-7fb75a989df2 req-e2812eb3-af09-4c4e-9328-fc758f2e0a03 service nova] Creating event network-vif-plugged:88c26c43-7e3b-4397-9280-7b9db97e3cc5 for instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f on hv-cinder-84984 Jul 19 15:32:16.937743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-5691c4af-72a3-4a54-8d1e-7fb75a989df2 req-e2812eb3-af09-4c4e-9328-fc758f2e0a03 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049388 Jul 19 15:32:16.938561 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 65/133] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:17.151692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:17.152695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:17.159620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:17.160223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:17.161627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:17.162255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:17.336873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:17.344584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-84f900a9-1d11-415b-b886-0f9f0c4d11cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.197682 Jul 19 15:32:17.345164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 69/134] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:17 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:18.362292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:18.362974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:18.369727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:18.370168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:18.370921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:18.371348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:18.500370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:18.502692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:18.509338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-88cbc471-c295-4925-b44c-0746326e4c4e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.151196 Jul 19 15:32:18.509909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 66/135] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:18 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:19.526668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:19.527300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:19.529341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=39 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.534676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:19.535120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:19.536745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:19.536973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:19.539757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=79 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.670757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:19.679062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-39a45305-2c8b-4cbd-87dc-5a7fd518c988 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.156540 Jul 19 15:32:19.679634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 70/136] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:19 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:20.507639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-54f13fd8-4106-4c79-966b-3582ba794402 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:20.510656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:20.517660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-54f13fd8-4106-4c79-966b-3582ba794402 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:20.518110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-54f13fd8-4106-4c79-966b-3582ba794402 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:20.577584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-54f13fd8-4106-4c79-966b-3582ba794402 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Going to try to stop instance {{(pid=118006) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 15:32:20.620124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-54f13fd8-4106-4c79-966b-3582ba794402 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action" status: 202 len: 0 microversion: 2.1 time: 0.116815 Jul 19 15:32:20.620722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 67/137] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:32:20 2022] POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:32:20.629070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:20.630478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:20.637053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:20.637798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:20.638548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:20.639061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:20.697480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:20.698308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:20.704901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:20.705503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:20.706353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:20.706865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:20.827229 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:20.837280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2ea04d72-ebda-487a-ac98-8338dde31dee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.211961 Jul 19 15:32:20.838420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 71/138] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:20 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:20.886101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:20.893428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-867be7cb-15d9-4836-bd28-25dffc2643fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.200929 Jul 19 15:32:20.893925 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 68/139] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:20 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:21.855184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:21.855887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:21.862203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:21.862704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:21.863572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:21.864599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:21.909872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:21.910491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:21.917083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:21.917556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:21.918309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:21.918734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:22.038172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:22.046178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f11459d2-087b-4c51-b260-450eef796d55 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.194905 Jul 19 15:32:22.046898 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 72/140] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:21 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:22.080586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:22.088053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-47e92077-accb-432f-a92d-f4daa57370a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1322 microversion: 2.1 time: 0.181994 Jul 19 15:32:22.088608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:21 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:23.065007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:23.068413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:23.074560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.075009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.075771 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.076202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.104471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:23.105079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:23.111610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.112054 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.112822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.113303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.261068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:23.269108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c27befaa-7c5f-4863-ae34-8fd6d21a6845 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.208293 Jul 19 15:32:23.269702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 73/142] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:23 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:23.296264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:23.304403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cf87e40c-0fb0-4ac2-ab50-86490d8739a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1516 microversion: 2.1 time: 0.203736 Jul 19 15:32:23.304980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:23 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1516 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:23.321111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:23.322127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:23.328067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.328512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.329285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.329712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.357816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lazy-loading 'flavor' on Instance uuid 07929d52-360d-4bb4-99bf-aef1e30a9b6f {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:32:23.470863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-52b51364-96a2-4cc6-92bc-8acee8c40deb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f/action" status: 200 len: 32 microversion: 2.1 time: 0.154299 Jul 19 15:32:23.471681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 74/144] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:32:23 2022] POST /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:32:23.480936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:23.481597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:23.487778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.488701 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.490643 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:23.491080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:23.620202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:23.629150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-96d659de-b300-472b-8c91-eebe09a41b88 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.151926 Jul 19 15:32:23.630749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:23 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:24.289012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:24.289727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:24.296065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:24.296509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:24.297285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:24.297713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:24.424054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:24.432416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f366b65c-a5f9-4dcb-b0c0-27378df17f7a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.148312 Jul 19 15:32:24.433035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 75/146] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:24 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:24.648244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:24.649078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:24.655650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:24.656091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:24.656875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:24.657339 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:24.786395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:24.793742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-01e3cc06-eae1-471c-b93b-8a11596709a4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.150054 Jul 19 15:32:24.794303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 72/147] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:24 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:25.449173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:25.449770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:25.455774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:25.456212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:25.456957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:25.457410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:25.586151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:25.593938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-87fcbe4a-50c8-4345-87af-7cd48158c3b9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.148607 Jul 19 15:32:25.594520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:25 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:25.811368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:25.811899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:25.819049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:25.819489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:25.820246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:25.820676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:25.950059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:25.957886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8ac32d43-f9d4-4287-a391-873635d8eec6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.150376 Jul 19 15:32:25.958439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 73/149] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:25 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:26.611117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:26.611714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:26.618471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:26.618920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:26.619689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:26.620473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:26.752722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:26.761425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-74add320-101f-43fc-8bed-24309573da7f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.154100 Jul 19 15:32:26.761994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:26 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:26.975004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:26.975606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:26.981810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:26.982254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:26.983012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:26.983445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:27.111919 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:27.120083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-22516441-bd88-490c-bdb3-c94a59c93d65 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.149073 Jul 19 15:32:27.120642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 74/151] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:26 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:27.779128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:27.779721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:27.786349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:27.786792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:27.787534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:27.787961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:27.917776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:27.925629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-36b7837a-5f6c-4c7c-9d15-24c19d6a16c8 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.150360 Jul 19 15:32:27.926696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 78/152] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:27 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:28.137496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:28.138108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:28.144462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:28.144955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:28.145808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:28.146321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:28.279967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:28.287469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-83baf096-b4c2-46dc-b18b-d2684ad4335c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.153704 Jul 19 15:32:28.288031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 75/153] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:28 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:28.943114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:28.943741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:28.949750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:28.950194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:28.950944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:28.951369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:29.091345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:29.100173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9414e459-b9d9-41cc-a9cb-d80d60e3367c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.161004 Jul 19 15:32:29.100842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 79/154] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:28 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:29.303905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:29.304552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:29.311319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:29.311661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:29.312418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:29.312847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:29.484277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:29.491935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e9ffaa14-b5d2-4768-af82-a5e4f9f46b7b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.192010 Jul 19 15:32:29.492507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 76/155] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:29 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:30.116833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:30.117466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:30.123466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:30.124083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:30.124837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:30.125292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:30.263620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:30.271664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d4ebad5c-69d2-4255-b63b-b4f7b8101123 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.158699 Jul 19 15:32:30.272225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 80/156] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:30 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:30.507649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:30.508259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:30.514926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:30.515363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:30.516125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:30.516562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:30.667427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:30.675655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b771e373-3ad0-4709-9c05-008fafec29fc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.171733 Jul 19 15:32:30.676894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 77/157] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:30 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:31.289411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:31.290114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:31.296525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:31.308643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:31.309478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:31.309910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:31.443244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:31.451208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aa0a49b9-e0a8-487d-953b-c58388b27182 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.166692 Jul 19 15:32:31.451769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:31 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:31.694075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:31.694612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:31.701023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:31.701500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:31.702262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:31.702736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:31.831530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:31.839133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-afad73a9-3d99-4076-a065-e866901e16a3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.149721 Jul 19 15:32:31.839694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 78/159] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:31 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:32.468390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:32.468939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:32.475905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:32.476358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:32.477123 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:32.477579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:32.619720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:32.628457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0e1dfb0-29c9-4144-99f8-13ab5b05017e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.163835 Jul 19 15:32:32.638837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 82/160] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:32 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:32.856310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:32.857060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:32.864625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:32.865152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:32.866026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:32.866474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:33.000668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:33.008487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-550c051f-1d8f-4d93-886f-d1f3e0e8932f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.156460 Jul 19 15:32:33.009053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:32 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:33.646859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:33.647460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:33.654894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:33.655353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:33.656127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:33.656542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:33.789399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:33.798308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0a603a8-06aa-4972-8e2b-c4872f56943c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.156262 Jul 19 15:32:33.798894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:33 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:34.025742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:34.026335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:34.033018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:34.033521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:34.034288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:34.034902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:34.180088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:34.187916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-28eb0246-6733-4c90-ad0c-6a4fabbaefa7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.166461 Jul 19 15:32:34.188546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:34 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:34.816571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:34.818316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:34.824324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:34.824775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:34.825554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:34.826138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:34.986815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:34.989272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:34.997647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bd81a750-8fc4-4ce3-a12b-2604b6fe4f5d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1721 microversion: 2.1 time: 0.185379 Jul 19 15:32:34.998441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:34 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:35.205096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:35.205832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:35.212615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:35.213226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:35.214136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:35.214739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:35.357076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:35.365412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb3fcc55-30d7-4d0a-9974-6202bec6d607 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.164118 Jul 19 15:32:35.366080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:35 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:36.019181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:36.020475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:36.029453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.030196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.031108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.031761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.184467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:36.193854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8828e2cf-8e40-4eeb-8665-94a5470e236e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1698 microversion: 2.1 time: 0.181585 Jul 19 15:32:36.194520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 85/166] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:36 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:36.213449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8a80cd4-9e65-457f-98cb-dc071049524c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:36.219866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8a80cd4-9e65-457f-98cb-dc071049524c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.220378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8a80cd4-9e65-457f-98cb-dc071049524c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.235156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:36.258558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f8a80cd4-9e65-457f-98cb-dc071049524c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Going to try to start instance {{(pid=118006) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 15:32:36.308250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f8a80cd4-9e65-457f-98cb-dc071049524c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action" status: 202 len: 0 microversion: 2.1 time: 0.098847 Jul 19 15:32:36.309483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 82/167] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:32:36 2022] POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:32:36.318595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:36.319625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:36.326910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.330679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.331739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.332582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.386076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:36.386881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:36.393642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.394357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.396188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:36.396992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:36.561750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:36.574738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0d01aef-404e-431c-bf0c-58cd4ab2efc1 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1707 microversion: 2.1 time: 0.260962 Jul 19 15:32:36.587502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 86/168] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:36 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1707 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:36.605221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:36.617443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d0441181-8211-429b-baad-1302e809a6fd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.235612 Jul 19 15:32:36.618035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 83/169] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:36 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:37.062324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:37.062823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:37.069003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.069510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.070377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.071022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.100938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dd36be7a-1a74-4c79-868d-2cb2c98f843f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/ips" status: 200 len: 151 microversion: 2.20 time: 0.042743 Jul 19 15:32:37.101548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 87/170] 10.222.0.42 () {60 vars in 1288 bytes} [Tue Jul 19 15:32:37 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:32:37.594349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:37.594986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:37.602668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.603118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.603894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.604330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.634559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:37.635165 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:37.641374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.641853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.642770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:37.643252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:37.811364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:37.821567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-143395e3-2a2d-45a0-b927-9041eb907c48 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1707 microversion: 2.1 time: 0.231016 Jul 19 15:32:37.822592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 84/171] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:37 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1707 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:37.835625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:37.843260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-604eff43-3f04-4a48-a291-00c67247e9cc tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.212573 Jul 19 15:32:37.843812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 88/172] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:37 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:38.013447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:38.014154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:38.021693 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.022258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:38.023788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.024341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:38.053966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fc6feaa9-e0c5-4476-a60a-a9313336ee18 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/ips" status: 200 len: 149 microversion: 2.1 time: 0.045697 Jul 19 15:32:38.054711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 85/173] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:32:38 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:38.842713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:38.843447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:38.849763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.850213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:38.850982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.851426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:38.860028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:38.860640 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:38.868970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.869691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:38.870468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:38.870993 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.154276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:39.163295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e5a4bbe9-dbd0-44f6-b6dd-e550ae64841a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1711 microversion: 2.1 time: 0.325208 Jul 19 15:32:39.163943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 89/174] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:38 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1711 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:39.168408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:39.179240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7e2a7384-15f0-4e2e-ba68-d555be221dca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.323127 Jul 19 15:32:39.179938 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:38 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:39.293389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:39.293961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:39.300217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.301093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.302130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.302717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.328032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lazy-loading 'flavor' on Instance uuid 6130f510-2f0f-4e30-9256-e9e1e590d9a7 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:32:39.469280 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:39.470448 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:39.477524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.480022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.480825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.481283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.672369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3eb2e2ab-0a75-4ab7-bed0-fb69369242b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/action" status: 202 len: 0 microversion: 2.20 time: 0.382313 Jul 19 15:32:39.677800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 90/176] 10.222.0.42 () {62 vars in 1318 bytes} [Tue Jul 19 15:32:39 2022] POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:32:39.695206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:39.697958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:39.708425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.708425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.708924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:39.709388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:39.849645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4bdd6715-254e-4099-8281-4e6ee19fe03f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384198 Jul 19 15:32:39.850254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 87/177] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:32:39 2022] POST /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:39.882936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:39.893539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:39.896198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:39.897487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3906725a-84d3-492d-b411-0b4ca127d84b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.210067 Jul 19 15:32:39.898673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 91/178] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:39 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:40.197715 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:40.198335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:40.204645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:40.205091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:40.205954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:40.206391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:40.338861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:40.346497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4396bd87-62be-4ec3-9964-07d5949b0e47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.153840 Jul 19 15:32:40.347226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 88/179] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:40 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:40.916738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:40.917387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:40.923328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:40.923781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:40.924545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:40.924979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:41.046256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1726835008", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "networks": [{"uuid": "efa248c6-f809-443b-90d1-a0be4a30443c"}]}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:41.074656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:41.082883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:41.084593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:41.085805 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f839541c-4ba3-4b90-96cd-c0f24dfb4df8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.173208 Jul 19 15:32:41.086366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 92/180] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:40 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:41.103900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] validate_networks() for [('efa248c6-f809-443b-90d1-a0be4a30443c', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:32:41.363746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:41.364346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:41.370637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:41.371373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:41.372334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:41.372768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:41.496115 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:32:41.496630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:32:41.497000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:32:41.497431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:32:41.497838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:32:41.507093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:41.507570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:41.508368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:41.508798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:41.526315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Getting quotas for project d8ba7f503b3c4afeb9736b241ac2bc98. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:32:41.530376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Getting quotas for user 51afc55d8978440bb5c9e951f9c51c59 and project d8ba7f503b3c4afeb9736b241ac2bc98. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:32:41.542721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:41.544847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:32:41.547167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:32:41.550450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9296b502-ccf4-4fa3-815e-334645445397 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.190609 Jul 19 15:32:41.551074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 93/181] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:41 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:41.595849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7106115e-2899-47d0-905c-b89885833473 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553444 Jul 19 15:32:41.596487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 89/182] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:32:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 15:32:41.607125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-100612d5-049d-46a2-828e-4fee408013c6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:41.607853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-100612d5-049d-46a2-828e-4fee408013c6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:41.667966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-100612d5-049d-46a2-828e-4fee408013c6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:41.674558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-100612d5-049d-46a2-828e-4fee408013c6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1214 microversion: 2.1 time: 0.071483 Jul 19 15:32:41.675122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 94/183] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:41 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:42.106820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:42.107503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:42.114123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.114560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.115315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.115740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.399490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:42.407307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:42.408799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:42.410512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c91039a8-42ab-4468-befd-1442b0ea107c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.307267 Jul 19 15:32:42.411132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 90/184] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:42 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:42.568094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:42.568631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:42.574971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.575459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.576255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.576785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.693638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:42.694267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:42.704689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.705790 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.707715 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:42.708821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:42.736682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:42.755077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0800530c-ba7a-493b-856d-49b1483b2fc4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.190800 Jul 19 15:32:42.755852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 95/185] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:42 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:42.793963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:42.802869 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0a85bfa9-3470-4b6e-81be-3da68414582c tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1284 microversion: 2.1 time: 0.114714 Jul 19 15:32:42.804246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 91/186] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:42 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:43.430045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:43.430652 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:43.436845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.438467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.438467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.438673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.572381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:43.581317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:43.582948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:43.584119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ca8bbdf8-d7a0-496e-961f-7d1ca4e3c429 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.158037 Jul 19 15:32:43.584681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 96/187] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:43 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:43.773105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:43.774008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:43.780675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.781119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.781911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.782344 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.824201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:43.824946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:43.831174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.831966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.832952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:43.833414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:43.992458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:44.001178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-164e940a-2f7e-484a-8d5a-6e272796bdd0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.233192 Jul 19 15:32:44.001988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 92/188] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:43 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:44.042643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:44.044102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-f79ef425-df32-495e-931c-c0eb844b923b req-8b71b73a-aa85-4618-99c0-f88c26cbf423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa862ef-0367-4269-9204-4fd86d338273", "tag": "dfa05e2d-e7bc-411d-887e-a285f60c3040"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:44.051769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e97297b4-2af0-418a-901d-75da6c400fbb tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.234360 Jul 19 15:32:44.054955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-f79ef425-df32-495e-931c-c0eb844b923b req-8b71b73a-aa85-4618-99c0-f88c26cbf423 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:44.054955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-f79ef425-df32-495e-931c-c0eb844b923b req-8b71b73a-aa85-4618-99c0-f88c26cbf423 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:44.055550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 97/189] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:43 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:44.066719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-f79ef425-df32-495e-931c-c0eb844b923b req-8b71b73a-aa85-4618-99c0-f88c26cbf423 service nova] Creating event network-changed:dfa05e2d-e7bc-411d-887e-a285f60c3040 for instance 1aa862ef-0367-4269-9204-4fd86d338273 on hv-cinder-84984 Jul 19 15:32:44.071959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-f79ef425-df32-495e-931c-c0eb844b923b req-8b71b73a-aa85-4618-99c0-f88c26cbf423 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041007 Jul 19 15:32:44.072557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 93/190] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:44.602976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:44.603592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:44.610323 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:44.610772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:44.611544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:44.612027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:44.752772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:44.761978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:44.763510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:44.764650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b3c59613-cbde-4706-9737-dfac8969004d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.166535 Jul 19 15:32:44.765229 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 98/191] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:44 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:45.020726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:45.021682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:45.028581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.029041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.029929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.030365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.069214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:45.069822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:45.075872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.076317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.077076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.077538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.214268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:45.221786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-31815678-4310-4e2c-9950-e1b32c06c994 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.206488 Jul 19 15:32:45.223120 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 94/192] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:45 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:45.246399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:45.254692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7267f1f1-8090-4c03-a16d-dafa1cbbe1d7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.189522 Jul 19 15:32:45.255602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 99/193] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:45 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:45.783575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:45.784194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:45.790183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.790623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.791374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:45.791802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:45.927986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:45.935778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:45.937306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:45.938516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e08a9b9f-d2f7-4768-8372-aa2062b4a49f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.158941 Jul 19 15:32:45.939066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 95/194] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:45 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:46.239379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:46.240060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:46.246184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.246629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:46.247393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.247827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:46.272081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:46.272684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:46.279321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.279757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:46.280508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.280939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:46.427580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:46.429889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:46.436878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6c26cc0b-0bb6-4d88-961f-5ad637acaa56 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.201819 Jul 19 15:32:46.437731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:46 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:46.456230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:46.463651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-863d727f-3194-4a87-95bd-53ed75bfc5a7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.196052 Jul 19 15:32:46.464205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 96/196] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:46 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:46.958624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:46.959228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:46.965924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.966370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:46.967207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:46.967644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:47.099933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:47.107839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:47.109364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:47.110512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3d247b43-6ddf-42f9-b231-90cbbcf84bd6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.156602 Jul 19 15:32:47.111060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 101/197] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:46 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:47.454013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:47.455225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:47.462132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:47.462577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:47.463342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:47.463771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:47.480522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:47.481126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:47.487014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:47.487459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:47.488728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:47.489264 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:47.665131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:47.673288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d406d00e-3536-4ccf-939d-4b99fbbaa2b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.223557 Jul 19 15:32:47.674202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 97/198] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:47 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:47.681075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:47.688485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8b4d9b3c-5e05-49db-9a94-3224da9e8fd5 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.211904 Jul 19 15:32:47.689050 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 102/199] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:47 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:48.128996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:48.129637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:48.135658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.136099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.136860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.137319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.152945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:48.269588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:48.278534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:48.280033 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:48.281431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f0f14904-7a38-4fa4-a7b7-d61258588dcf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.156191 Jul 19 15:32:48.282141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 98/200] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:48 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:48.439510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fab31b66-58e4-487d-ba28-661f4389a2c1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: .version_select at 0x7f8323690c10>, body: {"keypair": {"name": "tempest-keypair-1381261228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsm0wmlAQuP27nUg65OkYO5HFZ1q4gAXT0X/OWx5YeWc6wRblZHIszCaT86e0UfoTBME2aq5r5Rw0ZR8TZ6dEsDbK2BogA1S2JApDomIU6ngwQmU+fYA/YEa/RyflxDLQ=="}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:48.454270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-fab31b66-58e4-487d-ba28-661f4389a2c1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:32:48.458860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-fab31b66-58e4-487d-ba28-661f4389a2c1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:32:48.483580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fab31b66-58e4-487d-ba28-661f4389a2c1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049003 Jul 19 15:32:48.484242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 103/201] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:32:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:48.691570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:48.692273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:48.699481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.699927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.700882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.701645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.705290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:48.705901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:48.713691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.714430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.715213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:48.715655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:48.964592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:48.980505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:48.984218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-76a807ed-b3de-48b3-8b35-55ca4c4a3c98 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.282852 Jul 19 15:32:48.984916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 104/202] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:48 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:48.994302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0e5b6795-fa75-4ad1-a2b4-98d83b97f93d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.307061 Jul 19 15:32:48.995090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 99/203] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:48 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:49.170299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-2b62d6c3-2d7c-49a3-9ccf-4e35d69f28ba req-4cf0f9d2-6f01-4c1a-9a39-57fc89c0aa24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa862ef-0367-4269-9204-4fd86d338273", "name": "network-vif-plugged", "status": "completed", "tag": "dfa05e2d-e7bc-411d-887e-a285f60c3040"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:49.183936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-2b62d6c3-2d7c-49a3-9ccf-4e35d69f28ba req-4cf0f9d2-6f01-4c1a-9a39-57fc89c0aa24 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:49.184693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-2b62d6c3-2d7c-49a3-9ccf-4e35d69f28ba req-4cf0f9d2-6f01-4c1a-9a39-57fc89c0aa24 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:49.198940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-2b62d6c3-2d7c-49a3-9ccf-4e35d69f28ba req-4cf0f9d2-6f01-4c1a-9a39-57fc89c0aa24 service nova] Creating event network-vif-plugged:dfa05e2d-e7bc-411d-887e-a285f60c3040 for instance 1aa862ef-0367-4269-9204-4fd86d338273 on hv-cinder-84984 Jul 19 15:32:49.204906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-2b62d6c3-2d7c-49a3-9ccf-4e35d69f28ba req-4cf0f9d2-6f01-4c1a-9a39-57fc89c0aa24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Jul 19 15:32:49.205846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 105/204] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:49.307641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:49.308878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:49.321244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:49.322092 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:49.323474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:49.324221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:49.465914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:49.475024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:49.476627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:49.477936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-900ab832-c75b-49ff-bf9a-1751acf2aa63 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.179433 Jul 19 15:32:49.478927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 100/205] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:49 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:50.002604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:50.003319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:50.005281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:50.013440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:50.014805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:50.016587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.017327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.018297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.018739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.022235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.023660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.024558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.025055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.248100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:50.256043 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:50.261660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-593824aa-ea47-4dd6-849b-a3817ac4f8ad tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.263118 Jul 19 15:32:50.262235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 106/206] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:49 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:50.263497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8a471031-ad0b-408a-9557-6292fe2ab2c5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.255530 Jul 19 15:32:50.274082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 101/207] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:50 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:50.276882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1918076180", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc814b7d-034a-42a8-85dc-8ab08a546a8c"}], "security_groups": [{"name": "tempest-securitygroup--517025159"}], "key_name": "tempest-keypair-1381261228", "user_data": "}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:50.381017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] validate_networks() for [('fc814b7d-034a-42a8-85dc-8ab08a546a8c', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:32:50.495778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:50.496381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:50.502401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.502853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.503722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.504158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.742230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:50.750866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:50.752817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:50.754525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-70c0cc02-9aaa-455d-907b-3318f392444a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.262474 Jul 19 15:32:50.755314 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 102/208] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:50 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:32:50.872181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:32:50.872631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:32:50.873101 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:32:50.873566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:32:50.873994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:32:50.883045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.883527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.884357 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:50.884797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:50.902110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:32:50.906425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:32:50.918345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:32:50.920567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:32:50.967928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-426c4be0-ff47-4953-9a87-ccbc24a9cb72 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704086 Jul 19 15:32:50.968494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 107/209] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:32:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:32:50.979710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cbee81f4-4247-4f92-b9ce-4cdbcb237294 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:50.996519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cbee81f4-4247-4f92-b9ce-4cdbcb237294 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:50.996519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.047377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cbee81f4-4247-4f92-b9ce-4cdbcb237294 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.056154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cbee81f4-4247-4f92-b9ce-4cdbcb237294 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1242 microversion: 2.1 time: 0.080334 Jul 19 15:32:51.056734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 103/210] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:50 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:51.279929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:51.280543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:51.281031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:51.284030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:51.289380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.289878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.290697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.291543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.303851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.304400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.305293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.305808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.511494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.517100 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:51.519955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-abb7b76e-abaa-4233-9746-84cf615bff20 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1314 microversion: 2.1 time: 0.243864 Jul 19 15:32:51.520537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 104/211] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:51 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:51.523971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.531605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-21a6b1f7-7e81-4a1f-8423-90474c4cef7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.255542 Jul 19 15:32:51.532227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 108/212] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:51 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:51.774905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:51.775547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:51.781984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.782438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.783238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:51.783681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:51.923648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.932322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.934120 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:51.935294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-94ec5be5-dec7-4bac-a244-3fe5ee790ac3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.165122 Jul 19 15:32:51.935850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 105/213] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:51 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:52.074761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:52.075443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:52.082408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.082986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.084666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.085113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.166355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:52.174511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dc9fa045-a0f4-443a-a8c4-0be2062ea11d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1312 microversion: 2.1 time: 0.104987 Jul 19 15:32:52.175203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 109/214] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:52 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:52.537125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:52.537750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:52.544443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.544886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.545755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.546183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.552757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:52.553715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:52.560139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.560698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.561753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.562263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.753495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:52.760560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:52.762447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a77cd5e2-5ce8-44db-a1f0-95c1b9545501 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1498 microversion: 2.1 time: 0.228697 Jul 19 15:32:52.775047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 106/215] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:52 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:52.775346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-76a26503-b621-4205-bf33-4061896af574 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.220660 Jul 19 15:32:52.775346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 110/216] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:52 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:52.953761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:52.954450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:52.963694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.964489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:52.965587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:52.966383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.169297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.182331 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.184480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.185719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-12893305-103a-4aa7-8e2a-280a537b9325 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.236272 Jul 19 15:32:53.186494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 107/217] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:52 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:53.193308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:53.194221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:53.209546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.209989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.210953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.211376 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.385052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.394954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eda13165-4baf-4fb4-85a8-0c2e622dcc16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.205568 Jul 19 15:32:53.406521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 111/218] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:53 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:53.412560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:53.413079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:53.420968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.421377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.422155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.422595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.450307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:32:53.531455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a95dc57a-cdeb-42a3-8fa6-3a85abe61cb9 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 204 len: 0 microversion: 2.1 time: 0.124308 Jul 19 15:32:53.532051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 108/219] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:32:53 2022] DELETE /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:32:53.541759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:53.542370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:53.548642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.549078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.550230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.550442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.696432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.705695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-442a4d1d-ff21-456f-80f7-6cca3fe5dbd1 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1504 microversion: 2.1 time: 0.167756 Jul 19 15:32:53.706759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 112/220] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:53 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:53.789110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:53.789882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:53.796187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.796635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.797462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.797907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.845789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-d05e928e-4787-48f3-8a79-ec2d0042a324 req-b1823420-8949-4b9e-bdfa-aada2b467081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f4a1ee-aa79-4dad-917e-ba073bdbc3da", "tag": "d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:53.865986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-d05e928e-4787-48f3-8a79-ec2d0042a324 req-b1823420-8949-4b9e-bdfa-aada2b467081 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:53.869323 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-d05e928e-4787-48f3-8a79-ec2d0042a324 req-b1823420-8949-4b9e-bdfa-aada2b467081 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:53.889724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-d05e928e-4787-48f3-8a79-ec2d0042a324 req-b1823420-8949-4b9e-bdfa-aada2b467081 service nova] Creating event network-changed:d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60 for instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da on hv-cinder-84984 Jul 19 15:32:53.895301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-d05e928e-4787-48f3-8a79-ec2d0042a324 req-b1823420-8949-4b9e-bdfa-aada2b467081 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053841 Jul 19 15:32:53.895917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 113/221] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:53.977596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:53.985652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-356f70e8-e3ea-44b2-b38c-c77aa9693db0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.202269 Jul 19 15:32:53.986237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 109/222] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:53 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:54.207106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:54.208035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:54.214712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.215158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.215998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.216356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.352649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:54.360532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:54.362062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:54.363733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-64d26f17-6132-4142-b625-996022689ceb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.161794 Jul 19 15:32:54.364286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 114/223] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:54 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:54.413334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:54.413944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:54.419975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.420415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.421261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.421697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.554038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:54.561508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3031b835-bcf9-4c23-9668-5b976dc07618 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.152583 Jul 19 15:32:54.562082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 110/224] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:54 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:54.724185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:54.724812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:54.730770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.731209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.731964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:54.732424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:54.861413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:54.868966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea696a7e-7cab-499b-85d5-6f38f2f66b42 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1504 microversion: 2.1 time: 0.149065 Jul 19 15:32:54.869565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 115/225] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:54 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:55.002537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:55.003173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:55.009590 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.010036 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.010805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.011215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.146857 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:55.154737 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-126960d9-1b2c-42b2-ab0d-c1008544f638 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.156061 Jul 19 15:32:55.155308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 111/226] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:54 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:55.382456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:55.383402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:55.389807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.390378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.391129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.391569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.579778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:55.580898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:55.588915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.589803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.590797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.591390 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.892986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:55.903429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:55.904934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:55.916078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b5d0d057-ba78-4cf9-8dc7-4a4e6d024e88 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.538133 Jul 19 15:32:55.916660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 116/227] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:55 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:55.925454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:55.926074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:55.932589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.933270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.934190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:55.934786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:55.939029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:55.949947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-76a41bae-9581-486b-873f-efb03878fb49 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.374878 Jul 19 15:32:55.950830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 112/228] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:55 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:56.060292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:56.069550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-119a12e7-392d-45b6-9642-c4d063386238 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1462 microversion: 2.1 time: 0.148214 Jul 19 15:32:56.070236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 117/229] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:55 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1462 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:56.102383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-66ed8b4d-e278-4e1b-bb14-270141271503 req-dfaece21-2b85-4ed4-a995-e8a1eaf4c35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa862ef-0367-4269-9204-4fd86d338273", "name": "network-vif-deleted", "tag": "dfa05e2d-e7bc-411d-887e-a285f60c3040"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:56.113411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-66ed8b4d-e278-4e1b-bb14-270141271503 req-dfaece21-2b85-4ed4-a995-e8a1eaf4c35a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.113807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-66ed8b4d-e278-4e1b-bb14-270141271503 req-dfaece21-2b85-4ed4-a995-e8a1eaf4c35a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.125094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-66ed8b4d-e278-4e1b-bb14-270141271503 req-dfaece21-2b85-4ed4-a995-e8a1eaf4c35a service nova] Creating event network-vif-deleted:dfa05e2d-e7bc-411d-887e-a285f60c3040 for instance 1aa862ef-0367-4269-9204-4fd86d338273 on hv-cinder-84984 Jul 19 15:32:56.130239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-66ed8b4d-e278-4e1b-bb14-270141271503 req-dfaece21-2b85-4ed4-a995-e8a1eaf4c35a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 Jul 19 15:32:56.130833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 113/230] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:32:56.172288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:56.172963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:56.179845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.180358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.181127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.181583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.318959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:56.326602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b63f2829-692b-4ea7-b9cd-8c0530729546 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.158163 Jul 19 15:32:56.327031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 118/231] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:56 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:56.944030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:56.944712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:56.951208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.951658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.952521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.953090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.967265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:56.967833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:56.982725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.983453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:56.984392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:56.984981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.124710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.134424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.135929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.137121 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e48b0eef-06cf-4a96-9b6c-e4bfbe86ceb2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.198368 Jul 19 15:32:57.149463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 114/232] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:56 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:57.149463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:57.149463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:57.157071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:57.157559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.158570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:57.159145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.192606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.213638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:57.214084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.214543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lazy-loading 'fault' on Instance uuid 1aa862ef-0367-4269-9204-4fd86d338273 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:32:57.312518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.323560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dd399850-3c8c-4550-81b7-e43fcef2069b tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 200 len: 1304 microversion: 2.1 time: 0.184446 Jul 19 15:32:57.324296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 115/233] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:57 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:57.343949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:57.344561 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:57.351323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:57.351782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.352581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:57.353015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:57.432113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.440721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-207df162-c588-4392-b157-2c9f56239c9a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.477431 Jul 19 15:32:57.441374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 119/234] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:56 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:57.604239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:57.612220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-575d5281-b983-4da1-a05b-131a20a83a04 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.272180 Jul 19 15:32:57.612976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 116/235] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:57 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:58.156792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:58.157563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:58.165024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.165715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.166678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.167114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.183064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:58.324165 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:58.333240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:58.334998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:58.336684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a3d9d32b-fd4d-4429-836f-d828185f228c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.184126 Jul 19 15:32:58.337433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 120/236] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:58 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:32:58.341805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:58.342427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: 1aa862ef-0367-4269-9204-4fd86d338273] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:58.351489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.356538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.357522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.357987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.376088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] HTTP exception thrown: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Request method failure captured: Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 HTTP/1.1 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s6X851AECkELxWaArqvmOI7IdEl6ZrRWS4dZnx0yJlMG2BFLcJYv483XTCmqYldIoecIi-AGDRNEzo1mLkowDKh-EODZobpsy6R6TpOxQlB2owomVRyAxwdc6pRRdEbnRKSQw2l4OZYqqMdAKRvZoPk0cHQEAQd_KXgr4vlH5lEG4U Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: d8ba7f503b3c4afeb9736b241ac2bc98 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesActionsTest-2038856571 Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:32:58.378577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d8ba7f503b3c4afeb9736b241ac2bc98"}]}] Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesActionsTest-2038856571 Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: d8ba7f503b3c4afeb9736b241ac2bc98 Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesActionsTest-2038856571 Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesActionsTest-2038856571-project Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 51afc55d8978440bb5c9e951f9c51c59 Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesActionsTest-2038856571-project Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. Jul 19 15:32:58.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '1aa862ef-0367-4269-9204-4fd86d338273'} Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:32:58.380660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. Jul 19 15:32:58.382862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:32:58.383902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Returning 404 to user: Instance 1aa862ef-0367-4269-9204-4fd86d338273 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:32:58.383902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c8b68802-643b-49b7-8497-d3f34551650d tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273" status: 404 len: 111 microversion: 2.1 time: 0.042829 Jul 19 15:32:58.392947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 117/237] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:58 2022] GET /compute/v2.1/servers/1aa862ef-0367-4269-9204-4fd86d338273 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:32:58.458372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:58.458982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:58.469787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.470049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.473295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.474100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.491706 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1297757792", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "networks": [{"uuid": "efa248c6-f809-443b-90d1-a0be4a30443c"}]}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:32:58.584854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] validate_networks() for [('efa248c6-f809-443b-90d1-a0be4a30443c', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:32:58.760795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:58.773939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a2abecc9-534b-42eb-8105-7fd53ef1ea43 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.320096 Jul 19 15:32:58.783387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:58 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:58.783387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:58.783387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:58.786756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.787275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.788212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:58.788714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:58.993332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.001114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ce089056-6913-4755-8c12-478cbe2eb105 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.225083 Jul 19 15:32:59.001823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 122/239] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:58 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:32:59.100740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:32:59.101181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:32:59.101796 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:32:59.102075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:32:59.102487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:32:59.117316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.118318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.119126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.119591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.144940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Getting quotas for project d8ba7f503b3c4afeb9736b241ac2bc98. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:32:59.150354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Getting quotas for user 51afc55d8978440bb5c9e951f9c51c59 and project d8ba7f503b3c4afeb9736b241ac2bc98. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:32:59.166058 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:32:59.168935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:32:59.224743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-44c24ac7-ac9c-48ab-8d46-0726fada0ab3 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736732 Jul 19 15:32:59.230788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 118/240] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:32:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:32:59.236698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cb9870ca-3460-4b88-ac1c-0b55e2785f86 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:59.238783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cb9870ca-3460-4b88-ac1c-0b55e2785f86 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:59.313615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cb9870ca-3460-4b88-ac1c-0b55e2785f86 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.324073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cb9870ca-3460-4b88-ac1c-0b55e2785f86 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1214 microversion: 2.1 time: 0.092318 Jul 19 15:32:59.325489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 123/241] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:59 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:32:59.357326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:59.357921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:59.373152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.373615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.381579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.382353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.653810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.681533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.694012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.694012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fec0e08a-d381-4081-890c-fed9438db097 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.337216 Jul 19 15:32:59.694012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 119/242] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:32:59 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:32:59.794704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:32:59.796897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:32:59.808790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.809902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.811277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:32:59.812254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:32:59.960246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:32:59.973249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-766fc39e-b7ca-445a-8b3d-e8c1951c0efb tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.184498 Jul 19 15:32:59.974190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 124/243] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:32:59 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:00.020357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:00.021042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:00.027623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.028437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.029593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.030298 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.208454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:00.220479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bc1a3b85-23b5-4b84-8ae6-3cd5b54497e2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.205599 Jul 19 15:33:00.232166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 120/244] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:00 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:00.341427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:00.343623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:00.356168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.357082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.358091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.358737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.483778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:00.510165 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9200fc3f-0580-4fd1-a35c-803e9108cdfa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1266 microversion: 2.1 time: 0.172638 Jul 19 15:33:00.521028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 125/245] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:00 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:00.711371 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:00.712934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:00.722470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.723500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.724770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:00.726239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:00.994512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:00.995386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:00.998320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:01.014370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.015003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.015836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.016258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.129753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.145683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.158546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.160079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1e51a5ed-0d88-41d0-9020-49f71f56a5d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1742 microversion: 2.20 time: 0.453658 Jul 19 15:33:01.161213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 121/246] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:00 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1742 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:01.218293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.228133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d1e5d877-0681-4618-932f-f50d6e8b0ce7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.240312 Jul 19 15:33:01.229085 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:00 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:01.240045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:01.240957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:01.249614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.250782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.251981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.252566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.457883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.469041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cf9294f6-56cb-4715-8fc7-cfcec9220370 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.233676 Jul 19 15:33:01.469680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 122/248] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:01 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:01.530978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:01.532394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:01.541019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.542806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.544371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:01.547053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:01.664470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:01.672640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-033994a2-9ff7-44d1-901d-17cb42183007 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1272 microversion: 2.1 time: 0.147671 Jul 19 15:33:01.678740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 127/249] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:01 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1272 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:02.182134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:02.184758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:02.196582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.197248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.198323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.199638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.246236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:02.247061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:02.262309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.262785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.263593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.265781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.569787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:02.583283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:02.587465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:02.588693 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-098494d3-eb65-40de-a490-cec2678f4817 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1742 microversion: 2.20 time: 0.412722 Jul 19 15:33:02.595467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 123/250] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:02 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1742 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:02.602238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:02.604950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:02.622299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.623739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.626059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.628514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.652511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:02.685809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3ccb63df-a30f-4d2d-a22b-68561bd9079c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.443523 Jul 19 15:33:02.688927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 128/251] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:02 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:02.706944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-db28b4e6-8b84-4585-bbbb-4fdef4d7ddc3 req-86bd174c-ef97-4e7b-8eeb-c22eb661e27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4a1ee-aa79-4dad-917e-ba073bdbc3da", "name": "network-vif-plugged", "status": "completed", "tag": "d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:02.725564 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-db28b4e6-8b84-4585-bbbb-4fdef4d7ddc3 req-86bd174c-ef97-4e7b-8eeb-c22eb661e27d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.730219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-db28b4e6-8b84-4585-bbbb-4fdef4d7ddc3 req-86bd174c-ef97-4e7b-8eeb-c22eb661e27d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.751368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-db28b4e6-8b84-4585-bbbb-4fdef4d7ddc3 req-86bd174c-ef97-4e7b-8eeb-c22eb661e27d service nova] Creating event network-vif-plugged:d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60 for instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da on hv-cinder-84984 Jul 19 15:33:02.759275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-db28b4e6-8b84-4585-bbbb-4fdef4d7ddc3 req-86bd174c-ef97-4e7b-8eeb-c22eb661e27d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063629 Jul 19 15:33:02.761061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 129/252] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:02.773289 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:02.774009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:02.781114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.782474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:02.783545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:02.784598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.087953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.095550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2a96fa97-9e60-4039-87ba-a5ef005f7444 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.498966 Jul 19 15:33:03.101878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:02 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:03.200637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.215546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05808162-ffca-40c3-929d-0367c66d0dab tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.450793 Jul 19 15:33:03.216155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 130/254] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:02 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:03.541445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-fd290b6d-6ec8-4b6f-849a-e53efce7aab4 req-b8e73c98-78f9-4391-9ccf-870d03ec4513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca30834-ecb1-4980-a214-1fc18be81aef", "tag": "a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:03.553808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-fd290b6d-6ec8-4b6f-849a-e53efce7aab4 req-b8e73c98-78f9-4391-9ccf-870d03ec4513 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:03.554707 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-fd290b6d-6ec8-4b6f-849a-e53efce7aab4 req-b8e73c98-78f9-4391-9ccf-870d03ec4513 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.567902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-fd290b6d-6ec8-4b6f-849a-e53efce7aab4 req-b8e73c98-78f9-4391-9ccf-870d03ec4513 service nova] Creating event network-changed:a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5 for instance aca30834-ecb1-4980-a214-1fc18be81aef on hv-cinder-84984 Jul 19 15:33:03.579558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-fd290b6d-6ec8-4b6f-849a-e53efce7aab4 req-b8e73c98-78f9-4391-9ccf-870d03ec4513 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043053 Jul 19 15:33:03.580422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 125/255] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:33:03.611054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:03.612263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:03.625181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:03.625631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.626422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:03.626859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.707271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:03.708092 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:03.721985 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:03.722544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.723422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:03.725463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:03.858065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.872991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.874817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.879075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-251f8c6a-a08d-410d-994b-b6543aa271e4 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1742 microversion: 2.20 time: 0.271932 Jul 19 15:33:03.880184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 131/256] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:03 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1742 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:03.945278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:03.953472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-835db4fc-120a-4bd5-b5ea-ec686a4fa2a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.251588 Jul 19 15:33:03.964387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 126/257] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:03 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:04.114043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:04.115032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:04.122903 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.123709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.125160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.125840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.232074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:04.233176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:04.248361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.249664 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.252070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.252475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.686551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:04.695577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-56e0620a-a5a2-41fe-91ed-f31d1bc2bddf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.586295 Jul 19 15:33:04.707155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 132/258] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:04 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:04.710228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:04.719447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-545452a7-688d-4b18-800e-145e655ac0ee tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.491325 Jul 19 15:33:04.720030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 127/259] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:04 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:04.780121 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-c27cb5b0-1e72-4bb1-beec-b98c67170d0d req-c9b64214-c13f-4faf-9212-30aaa0ecd4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "name": "network-vif-plugged", "status": "completed", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:04.791077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-c27cb5b0-1e72-4bb1-beec-b98c67170d0d req-c9b64214-c13f-4faf-9212-30aaa0ecd4eb service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.791545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-c27cb5b0-1e72-4bb1-beec-b98c67170d0d req-c9b64214-c13f-4faf-9212-30aaa0ecd4eb service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.810325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-c27cb5b0-1e72-4bb1-beec-b98c67170d0d req-c9b64214-c13f-4faf-9212-30aaa0ecd4eb service nova] Creating event network-vif-plugged:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:33:04.824787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-c27cb5b0-1e72-4bb1-beec-b98c67170d0d req-c9b64214-c13f-4faf-9212-30aaa0ecd4eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045497 Jul 19 15:33:04.825468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 133/260] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:04.898551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:04.899151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:04.908047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.908503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.910055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:04.910501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:04.985511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:04.986412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:05.010784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.012837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:05.013785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.017910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:05.436281 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:05.452893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:05.461567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:05.463170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d90068fd-b9a1-4ade-b7b7-b0e42c83d075 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1742 microversion: 2.20 time: 0.569385 Jul 19 15:33:05.465133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 128/261] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:04 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1742 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:05.490637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:05.539095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-caf48614-58b3-439a-9ce6-bc0c0d052198 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1367 microversion: 2.1 time: 0.563850 Jul 19 15:33:05.539760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 134/262] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:04 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:05.718044 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:05.718838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:05.739313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:05.740065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:05.759416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.760746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.761500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:05.763069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:05.765239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.766361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:05.768467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:05.771499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:06.574196 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:06.588126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ef433803-4582-445a-a27e-e6019cea9189 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.876711 Jul 19 15:33:06.594438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:06.602833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2969a128-58e6-4c29-8755-b6993b6d57d6 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.870661 Jul 19 15:33:06.603411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 135/263] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:05 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:06.612375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:05 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:06.614332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:06.615176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:06.618269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:06.618880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:06.629937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:06.630380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:06.631170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:06.631604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:06.635694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:06.636146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:06.636931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:06.637530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:06.965472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:06.977734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:06.980717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:06.981954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-915d0292-e8dc-4988-a35d-ce5d226c57a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.377615 Jul 19 15:33:06.984921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 136/265] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:06 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:07.022011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:07.032386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-38a49216-41f1-424d-8cca-bce3baaf06d1 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1556 microversion: 2.1 time: 0.426359 Jul 19 15:33:07.033472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 130/266] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:06 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1556 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:07.052668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:07.053200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:07.065696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.066172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:07.066981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.067414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:07.295222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f9863c1f-a890-4dbb-9080-cc6903d56bc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249041 Jul 19 15:33:07.295818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 137/267] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:33:07 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:07.625804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:07.628039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:07.629830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:07.636567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:07.682028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.684299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:07.684521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.686260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:07.687825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.689752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:07.690502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:07.693258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:08.381978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:08.396788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-09ac8e00-17e0-4d4d-b7c1-e20673a6b4cf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.776442 Jul 19 15:33:08.397689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 138/268] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:07 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:08.410903 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:08.411784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:08.430701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:08.432013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:08.433541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:08.438310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:08.531863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:08.546225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fb3b66e9-64df-4dd3-becc-ab75532ad917 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.928394 Jul 19 15:33:08.547172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 131/269] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:07 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:08.813267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:08.827763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:08.840060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:08.842043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:08.843509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6ebe78d0-6c9f-4f9b-ba0d-c9cc059c3cce tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.443015 Jul 19 15:33:08.844333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 139/270] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:08 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:09.416663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:09.417463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:09.421852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.426747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=14 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.438898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:09.439520 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:09.441065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:09.443031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:09.567426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:09.568405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:09.571443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=14 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.586494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:09.588641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:09.590710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:09.592642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:10.062876 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:10.080408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e0a47f7d-6f12-4038-8984-1e8f371bc304 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.519746 Jul 19 15:33:10.082061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 140/271] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:09 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:10.122123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:10.133910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ec3ad99f-c1e2-45ca-b70a-38f5e24e26db tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.722586 Jul 19 15:33:10.135136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 132/272] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:09 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:10.151722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:10.152909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:10.168982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:10.169451 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:10.170230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:10.170657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:10.219423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:10.570645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:10.581973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:10.583867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:10.585320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-264177c0-cf85-43b9-8e31-f8e716b6ff9d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.449126 Jul 19 15:33:10.592419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 133/273] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:10 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:10.597704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-8e8f0b66-37cf-4d29-be4c-c8e3fc3c46f0 req-4affcd82-455e-4348-9e3e-f2583df6e34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8f4a1ee-aa79-4dad-917e-ba073bdbc3da", "tag": "d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:10.619015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8e8f0b66-37cf-4d29-be4c-c8e3fc3c46f0 req-4affcd82-455e-4348-9e3e-f2583df6e34d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:10.619731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8e8f0b66-37cf-4d29-be4c-c8e3fc3c46f0 req-4affcd82-455e-4348-9e3e-f2583df6e34d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:10.630326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9b612ae9-45b4-4a23-91ae-5c3164d24b0c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Action: 'create', calling method: .version_select at 0x7f832375aa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1111119745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnEUHBhxlGpAWZ7kt95ysh3mdmu99elCNMbEAYd6AZG40X/ueNTMOAeM5dy+uYXRBSLOzM0PA0rN8pMqdmrjsnpyOz1zHdOAkGhDldPNN9WafPEJTqKLOolnAc8esETyg=="}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:10.638072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-8e8f0b66-37cf-4d29-be4c-c8e3fc3c46f0 req-4affcd82-455e-4348-9e3e-f2583df6e34d service nova] Creating event network-changed:d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60 for instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da on hv-cinder-84984 Jul 19 15:33:10.646303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-8e8f0b66-37cf-4d29-be4c-c8e3fc3c46f0 req-4affcd82-455e-4348-9e3e-f2583df6e34d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052368 Jul 19 15:33:10.648342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 134/274] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:10.658769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-9b612ae9-45b4-4a23-91ae-5c3164d24b0c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Getting quotas for project 286e8f4ce0854bf3a8563bcea08ae93a. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:33:10.663586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-9b612ae9-45b4-4a23-91ae-5c3164d24b0c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Getting quotas for user dee7cef53eb641bb93c92e3c524c59db and project 286e8f4ce0854bf3a8563bcea08ae93a. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:33:10.702246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9b612ae9-45b4-4a23-91ae-5c3164d24b0c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.614792 Jul 19 15:33:10.703258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 141/275] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:33:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:11.100169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:11.100876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:11.125354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.125973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:11.129373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.130762 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:11.155531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:11.156184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:11.158541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:11.183023 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.183478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:11.188773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.191424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:11.602858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:11.617734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2fb4da61-c2a9-4791-8047-4ad4c9f147d8 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.522930 Jul 19 15:33:11.626311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:11.635430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05ec27ad-c748-4978-bff4-04788be6bdab tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1522 microversion: 2.1 time: 0.485010 Jul 19 15:33:11.645947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 135/276] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:11 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:11.649125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 142/277] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:11 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:11.652254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:11.652890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:11.665375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.666384 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:11.667711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:11.668641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:12.041822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:12.066927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:12.073406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:12.074916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-de1cc4eb-6d77-4af6-8d10-c562373dc5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.427676 Jul 19 15:33:12.101455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 136/278] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:11 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:12.366379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-ad3d6834-485e-47cb-9f01-50c9a67d6a50 req-16615721-3b78-4ff9-9258-5715e7c9900c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca30834-ecb1-4980-a214-1fc18be81aef", "name": "network-vif-plugged", "status": "completed", "tag": "a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:12.393818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ad3d6834-485e-47cb-9f01-50c9a67d6a50 req-16615721-3b78-4ff9-9258-5715e7c9900c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:12.401116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ad3d6834-485e-47cb-9f01-50c9a67d6a50 req-16615721-3b78-4ff9-9258-5715e7c9900c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:12.439339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-ad3d6834-485e-47cb-9f01-50c9a67d6a50 req-16615721-3b78-4ff9-9258-5715e7c9900c service nova] Creating event network-vif-plugged:a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5 for instance aca30834-ecb1-4980-a214-1fc18be81aef on hv-cinder-84984 Jul 19 15:33:12.464152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-ad3d6834-485e-47cb-9f01-50c9a67d6a50 req-16615721-3b78-4ff9-9258-5715e7c9900c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100425 Jul 19 15:33:12.466642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 143/279] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:12.659636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:12.660392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:12.660999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:12.664601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:12.679031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:12.686667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:12.687512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:12.687948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:12.702830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:12.703586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:12.710802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:12.711273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:13.126477 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.136935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1b80bb19-9d49-4d51-b9cc-2e40a3174d6f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1502 microversion: 2.1 time: 0.487360 Jul 19 15:33:13.137856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 137/280] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:12 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1502 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:13.138851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.142647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:13.143446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:13.146482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2ba5f227-e2df-4682-8f6e-dcd502492b8a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.495990 Jul 19 15:33:13.147048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 144/281] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:12 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:13.153351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:13.153992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:13.155042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:13.155475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:13.161701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:13.162680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:13.172562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:13.173006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:13.173802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:13.174300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:13.398412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.412532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-79176505-70d7-4b34-b7bb-bbebd562b6cb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1516 microversion: 2.1 time: 0.252197 Jul 19 15:33:13.414638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 145/282] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:13 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1516 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:13.419330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.430422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.433053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:13.434495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d778916e-9c58-4ed3-8ac9-39de94cb4f06 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.295654 Jul 19 15:33:13.435795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 138/283] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:13 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:14.164864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:14.165497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:14.178767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:14.183398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:14.184216 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:14.184656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:14.455956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:14.457241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:14.468586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:14.469347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:14.470390 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:14.471088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:14.495598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:14.504617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4ed7c806-195b-4d1b-aaa9-d26743a024fa tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1314 microversion: 2.1 time: 0.343935 Jul 19 15:33:14.506501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 146/284] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:14 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:14.693121 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:14.701571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:14.711628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:14.713121 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b4c7c6ef-0a33-479a-86e7-594ebef969f2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.262758 Jul 19 15:33:14.713854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 139/285] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:14 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:15.160578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:15.161744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:15.180700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.181409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.182364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.182955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.222951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lazy-loading 'flavor' on Instance uuid 751332f2-549d-4fc4-91f6-7c217bb044c4 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:33:15.368763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0a2af435-f415-453c-a7e9-70e0e33b8b09 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/action" status: 200 len: 32 microversion: 2.1 time: 0.213458 Jul 19 15:33:15.369989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 147/286] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:33:15 2022] POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:33:15.380719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:15.381708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:15.392097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.393690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.396071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.401749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.530330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:15.541913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:15.561261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.561878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.562836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.563440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.775377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:15.789007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-edc6f707-39f8-41dc-8226-dd84b7322259 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.411989 Jul 19 15:33:15.789887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 140/287] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:15 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:15.798570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:15.801249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:15.805292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:15.823353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.824334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:15.825470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:15.826053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:16.092553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:16.115373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:16.117403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:16.119010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bfffc622-da0e-4e41-ba94-34aa830ce3be tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.327473 Jul 19 15:33:16.119805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 141/288] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:15 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:16.158057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:16.168349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cad07283-ed5d-40f4-9df7-500a12b901ff tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1499 microversion: 2.1 time: 0.646107 Jul 19 15:33:16.169252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 148/289] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:15 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1499 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:16.807346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:16.808051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:16.815380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:16.815860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:16.816721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:16.817214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:16.976303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:16.977779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:16.984758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:16.991864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:16.992706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:16.993830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:16.994324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:17.000284 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-efa2903e-5daf-4ea5-bd2c-59e7e8c48a27 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.197333 Jul 19 15:33:17.001291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:16 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:17.035200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:33:17.138222 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:17.139278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:17.152626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:17.155323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:17.156296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:17.158907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:17.199416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-10f6bd4e-ea15-44b5-9a16-ddc45fea04c7 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 204 len: 0 microversion: 2.1 time: 0.226702 Jul 19 15:33:17.200284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 149/291] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:33:16 2022] DELETE /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:33:17.214740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:17.215818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:17.224982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:17.225879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:17.226950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:17.227597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:17.391028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:17.401820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:17.403878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:17.405235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3240048a-6d04-4dc8-aa10-3badce05d355 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.272030 Jul 19 15:33:17.406262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 143/292] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:17 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:17.451833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:17.459852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1cdedef3-0489-4afe-979e-d38ad5ee3630 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1505 microversion: 2.1 time: 0.249952 Jul 19 15:33:17.460425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 150/293] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:17 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:18.018433 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:18.019380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:18.026460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.027070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.028064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.028616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.178807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:18.190477 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e0a068f3-9818-46c3-a568-73d5a3dd631f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.175620 Jul 19 15:33:18.192135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 144/294] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:18 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:18.426337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:18.426937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:18.432993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.433470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.434424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.435010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.477959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:18.478795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:18.485585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.486990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.488042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:18.490385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:18.698561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:18.709412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:18.712851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:18.714577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:18.715929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3425e521-7289-4963-9341-8f3e56633e0c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.295161 Jul 19 15:33:18.721847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c87d9b02-54b9-419c-b94d-3db54a3b3224 tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1505 microversion: 2.1 time: 0.247617 Jul 19 15:33:18.722948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 145/295] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:18 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:18.726753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 151/296] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:18 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:19.210269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:19.211341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:19.218767 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.219221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.219983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.220413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.521260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:19.540997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-67d7bc63-0785-4515-b93f-37b4b0aff09f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.333169 Jul 19 15:33:19.542349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:19 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:19.737809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:19.738882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:19.739728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:19.740084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:19.749740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.750696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.751938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.752600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.760104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.761737 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.763533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.766216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.910512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51afc55d8978440bb5c9e951f9c51c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ba7f503b3c4afeb9736b241ac2bc98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:19.925702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6be88214-eff6-4a31-a987-7ab8b8763eca tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 200 len: 1463 microversion: 2.1 time: 0.190986 Jul 19 15:33:19.936953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:19 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:19.937978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-7adaa124-f502-44d2-bbce-3d4ea3398613 req-024b2715-d580-4ef9-bd6c-42c5acdb0a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca30834-ecb1-4980-a214-1fc18be81aef", "name": "network-vif-deleted", "tag": "a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:19.949236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7adaa124-f502-44d2-bbce-3d4ea3398613 req-024b2715-d580-4ef9-bd6c-42c5acdb0a58 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:19.949841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7adaa124-f502-44d2-bbce-3d4ea3398613 req-024b2715-d580-4ef9-bd6c-42c5acdb0a58 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:19.964943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-7adaa124-f502-44d2-bbce-3d4ea3398613 req-024b2715-d580-4ef9-bd6c-42c5acdb0a58 service nova] Creating event network-vif-deleted:a9b5a2a6-ce6a-4e69-a67d-70960b4c8bc5 for instance aca30834-ecb1-4980-a214-1fc18be81aef on hv-cinder-84984 Jul 19 15:33:19.970706 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-7adaa124-f502-44d2-bbce-3d4ea3398613 req-024b2715-d580-4ef9-bd6c-42c5acdb0a58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041128 Jul 19 15:33:19.972019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 148/299] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:20.025555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:20.036733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:20.038766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:20.040046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4e807807-30cb-448d-a975-c106f94187e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.309440 Jul 19 15:33:20.040688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 152/300] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:19 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:20.563002 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:20.564601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:20.581793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:20.582164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:20.587529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:20.588238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:20.807520 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:20.826900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c1ab781a-8595-4e1a-a0a8-e65fecbc4bc5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.270534 Jul 19 15:33:20.827716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 149/301] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:20 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:20.950923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:20.951574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] [instance: aca30834-ecb1-4980-a214-1fc18be81aef] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:20.954401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:20.959569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:20.960013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:20.960779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:20.961224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:20.976247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] HTTP exception thrown: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Request method failure captured: Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef HTTP/1.1 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s6X851AECkELxWaArqvmOI7IdEl6ZrRWS4dZnx0yJlMG2BFLcJYv483XTCmqYldIoecIi-AGDRNEzo1mLkowDKh-EODZobpsy6R6TpOxQlB2owomVRyAxwdc6pRRdEbnRKSQw2l4OZYqqMdAKRvZoPk0cHQEAQd_KXgr4vlH5lEG4U Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: d8ba7f503b3c4afeb9736b241ac2bc98 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-VolumesActionsTest-2038856571 Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:33:20.977993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d8ba7f503b3c4afeb9736b241ac2bc98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d8ba7f503b3c4afeb9736b241ac2bc98"}]}] Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-VolumesActionsTest-2038856571 Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: d8ba7f503b3c4afeb9736b241ac2bc98 Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-VolumesActionsTest-2038856571 Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-VolumesActionsTest-2038856571-project Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 51afc55d8978440bb5c9e951f9c51c59 Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-VolumesActionsTest-2038856571-project Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. Jul 19 15:33:20.979547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'aca30834-ecb1-4980-a214-1fc18be81aef'} Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:33:20.980346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. Jul 19 15:33:20.981664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:20.982731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] Returning 404 to user: Instance aca30834-ecb1-4980-a214-1fc18be81aef could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:33:20.982731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05a1c4e2-55f2-4e97-b3a4-783e54d21a5a tempest-VolumesActionsTest-2038856571 tempest-VolumesActionsTest-2038856571-project] 10.222.0.42 "GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef" status: 404 len: 111 microversion: 2.1 time: 0.033155 Jul 19 15:33:20.982731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 153/302] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:20 2022] GET /compute/v2.1/servers/aca30834-ecb1-4980-a214-1fc18be81aef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:33:21.059112 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:21.059758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:21.072837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:21.074004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:21.075778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:21.076387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:21.463926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:21.473347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:21.476380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:21.477699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fe9b4df6-290b-4535-ac9e-5780ee5d8f29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.422898 Jul 19 15:33:21.478812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 150/303] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:21 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:21.852142 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:21.853075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:21.860394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:21.862162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:21.863111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:21.863676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:22.049964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:22.058127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a6a763ff-a392-49b5-b648-5536ad15d7ca tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.212709 Jul 19 15:33:22.058721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 154/304] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:21 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:22.497872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:22.498389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:22.506268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:22.506732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:22.507469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:22.507899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:22.524788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:22.644728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:22.652791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:22.654322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:22.655488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-090f79b9-621f-4705-ad38-d45928529d71 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.161476 Jul 19 15:33:22.656056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 151/305] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:22 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:23.075982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:23.076690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:23.086555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:23.087004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:23.087776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:23.088203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:23.090945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:23.223737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:23.231472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea00f4d0-6d31-4ea3-989c-9b3c62c5c207 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.160143 Jul 19 15:33:23.232046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 155/306] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:23 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:23.676158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:23.676791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:23.683610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:23.683995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:23.684761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:23.685217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:23.814022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:23.822006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:23.823466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:23.824651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5e07bd5a-4fc5-4833-8454-2d4321dbf5eb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1737 microversion: 2.20 time: 0.153103 Jul 19 15:33:23.827987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 152/307] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:23 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:24.249937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:24.250937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:24.258744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:24.259204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:24.260099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:24.260600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:24.396738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:24.404641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fe29182a-829b-41f0-9376-508be3d18949 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.158970 Jul 19 15:33:24.405290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 156/308] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:24 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:24.843532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:24.844163 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:24.851546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:24.852021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:24.852802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:24.853261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:24.982109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:24.990567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:24.992449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:24.993760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fcd929ae-da76-4ad3-9014-fe5c22d60b16 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1719 microversion: 2.20 time: 0.154279 Jul 19 15:33:24.994490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 153/309] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:24 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:25.423004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:25.424188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:25.430223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:25.430669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:25.431441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:25.431873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:25.564868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:25.572223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-036413e4-f9ef-4e54-9839-e1b2b981c371 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.153174 Jul 19 15:33:25.572778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 157/310] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:25 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:25.946141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-cfe251f5-10f5-42bc-aea5-bfef3a52f001 req-cdebdafa-0360-4702-ae5f-2d170c71bfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "name": "network-vif-unplugged", "status": "completed", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:25.954999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-cfe251f5-10f5-42bc-aea5-bfef3a52f001 req-cdebdafa-0360-4702-ae5f-2d170c71bfbf service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:25.955547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-cfe251f5-10f5-42bc-aea5-bfef3a52f001 req-cdebdafa-0360-4702-ae5f-2d170c71bfbf service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:25.969708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-cfe251f5-10f5-42bc-aea5-bfef3a52f001 req-cdebdafa-0360-4702-ae5f-2d170c71bfbf service nova] Creating event network-vif-unplugged:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:33:25.974528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-cfe251f5-10f5-42bc-aea5-bfef3a52f001 req-cdebdafa-0360-4702-ae5f-2d170c71bfbf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032143 Jul 19 15:33:25.975495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 154/311] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:26.015633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:26.016490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:26.023944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:26.024338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:26.025111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:26.025569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:26.233012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:26.241131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:26.242654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:26.243990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2214a305-0aea-478d-babb-f61a10154269 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1719 microversion: 2.20 time: 0.232300 Jul 19 15:33:26.244537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 158/312] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:26 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:26.590269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:26.590898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:26.597130 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:26.597672 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:26.598479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:26.599014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:26.732354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:26.740409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-22a6ab57-9806-4462-8207-6ec868336636 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.154366 Jul 19 15:33:26.741011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 155/313] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:26 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:27.263828 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:27.264533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:27.271679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.272213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.273274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.273863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.432110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:27.442189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:27.444063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:27.445425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-79cfdce5-2eab-4c40-a308-5ec65265eb5b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1719 microversion: 2.20 time: 0.185444 Jul 19 15:33:27.457723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 159/314] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:27 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:27.736709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:27.737440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:27.744405 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.747099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.748268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.748941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.758296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:27.759032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:27.769734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.770492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.771387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:27.771873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:27.909036 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lazy-loading 'services' on Instance uuid a6448684-07a9-4238-bcd7-8b1f4620d268 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:33:27.959753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:27.968691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-31bc8e01-eafd-48c3-aad6-0b7135ed74f6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.214326 Jul 19 15:33:27.969792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 160/315] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:27 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:28.045177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8c08d1eb-51e8-419a-84d4-23faf3fb7ded tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments/3feb7686-bb3d-4196-822f-fb727758f50f" status: 202 len: 0 microversion: 2.1 time: 0.312136 Jul 19 15:33:28.045976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 156/316] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:33:27 2022] DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments/3feb7686-bb3d-4196-822f-fb727758f50f => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:33:28.466821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:28.468469 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:28.476436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:28.477490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:28.479348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:28.480032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:28.639747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:28.649396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:28.651224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:28.652549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7abb9408-0af1-4808-9783-7073126275cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1719 microversion: 2.20 time: 0.191796 Jul 19 15:33:28.664834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 161/317] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:28 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:28.992124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:28.992901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:29.000481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.000963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:29.002614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.003085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:29.223726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:29.240067 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cd009268-8090-4ab1-ae6f-a4752ad14c8d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.252029 Jul 19 15:33:29.253097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 157/318] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:28 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:29.673292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:29.674583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:29.681219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.681794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:29.682759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.683210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:29.883360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:29.896111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:29.898941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:29.901955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ff317f2d-0f93-4d31-9734-f0f1395177e6 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1662 microversion: 2.20 time: 0.233320 Jul 19 15:33:29.902669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 162/319] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:29 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1662 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:29.923017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad7cbfd7-fb7d-4361-9ffb-087fea3f852b"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:29.924661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:29.931399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.931860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:29.932610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:29.933229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.258045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:30.258858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:30.266081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.266797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.268248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.268839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.302285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b205df91-c808-4dd8-8eb7-efb24826856c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385713 Jul 19 15:33:30.303066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 158/320] 10.222.0.42 () {62 vars in 1363 bytes} [Tue Jul 19 15:33:29 2022] POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:33:30.381911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cc683ee7-fa21-490b-87ae-81dae241b89e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:30.404804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cc683ee7-fa21-490b-87ae-81dae241b89e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.406676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cc683ee7-fa21-490b-87ae-81dae241b89e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.461570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cc683ee7-fa21-490b-87ae-81dae241b89e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Going to try to stop instance {{(pid=118006) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 15:33:30.508016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:30.514143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cc683ee7-fa21-490b-87ae-81dae241b89e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action" status: 202 len: 0 microversion: 2.1 time: 0.142836 Jul 19 15:33:30.514482 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 159/321] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:33:30 2022] POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:33:30.520691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:30.521375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:30.528306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.528755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.529558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.529989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.560774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-52ee30fc-667a-496f-9f26-98b3eb555af4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.303895 Jul 19 15:33:30.562369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 163/322] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:30 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:30.569108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:30.570401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:30.579154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.580797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.583810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.584708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.648153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5b5981a7-e95d-4410-a05c-c583addea192 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/action" status: 202 len: 0 microversion: 2.20 time: 0.132210 Jul 19 15:33:30.652219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 160/323] 10.222.0.42 () {62 vars in 1318 bytes} [Tue Jul 19 15:33:30 2022] POST /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:33:30.657361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:30.658055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:30.664534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.665512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.665769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:30.668464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:30.833802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:30.849545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b8dab882-a893-42c4-98c1-84d1aead791e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.282735 Jul 19 15:33:30.855858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 164/324] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:30 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:30.922319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:30.939562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:30.950409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:30.951829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-23d979bb-ee7d-4f48-8b3b-a95074ac95c1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1748 microversion: 2.20 time: 0.298557 Jul 19 15:33:30.952582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 161/325] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:30 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1748 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:31.587637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:31.589438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:31.599077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.600602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:31.601615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.602587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:31.825521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:31.848243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-69f96b6e-0fa8-478a-b7e8-0c129c7fa023 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.270174 Jul 19 15:33:31.854714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 165/326] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:31 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:31.874701 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:31.876559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:31.897379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.900093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:31.901355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.903216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:31.974778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:31.975562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:31.989399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.994755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:31.996038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:31.996840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:32.253484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:32.267658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:32.268979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:32.273725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:32.276793 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f95ae72d-3e02-42a8-869d-4cecb81c5246 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1750 microversion: 2.20 time: 0.306016 Jul 19 15:33:32.279813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2d7a322c-abd3-4f5e-9c55-10d7b02e2d2f tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.411149 Jul 19 15:33:32.290234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 162/328] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:31 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:32.290579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 166/328] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:31 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1750 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:32.305705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2031813929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1111119745", "security_groups": [{"name": "tempest-secgroup-smoke-55884639"}], "networks": [{"uuid": "b9c55ceb-2e48-4a6c-b200-990f267436e1"}], "block_device_mapping_v2": [{"uuid": "bc4668c0-e7f8-4f35-9f91-a202abe20ca4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:32.459946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] validate_networks() for [('b9c55ceb-2e48-4a6c-b200-990f267436e1', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:33:32.869198 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:32.869958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:32.876971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:32.877613 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:32.878214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:32.878651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:32.908201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:33.046051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:33:33.046586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:33:33.047126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:33:33.047653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:33:33.049073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:33:33.068038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.068883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.093338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.095067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.114037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.123150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-628525dc-7d29-4b96-9fdc-34edbbc6d8c3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.257749 Jul 19 15:33:33.135140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 163/329] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:32 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:33.146263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Getting quotas for project 286e8f4ce0854bf3a8563bcea08ae93a. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:33:33.151356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Getting quotas for user dee7cef53eb641bb93c92e3c524c59db and project 286e8f4ce0854bf3a8563bcea08ae93a. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:33:33.258817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:33:33.263810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc4668c0-e7f8-4f35-9f91-a202abe20ca4',volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:33:33.297310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:33.298868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:33.306258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.307394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.307850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.308351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.486004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-273ceb65-3449-4945-9a9d-eec821864c4b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.189970 Jul 19 15:33:33.489070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 167/330] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:33:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:33:33.503486 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:33.510650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:33.518354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.518890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.519831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:33.520369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:33.570657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.580758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c1a50d34-6430-42c5-a97f-f9ac218a9eb7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.286866 Jul 19 15:33:33.593745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 164/331] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:33 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:33.602214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e5e2e093-cfbb-46e1-be66-3cc607ae29c7 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:33.602914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e5e2e093-cfbb-46e1-be66-3cc607ae29c7 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:33.733001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e5e2e093-cfbb-46e1-be66-3cc607ae29c7 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.745471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e5e2e093-cfbb-46e1-be66-3cc607ae29c7 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1089 microversion: 2.1 time: 0.148122 Jul 19 15:33:33.757355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 165/332] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:33 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1089 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:33.799573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.808907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.810713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:33.811966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3ab6d3ec-9c11-40de-9287-cbf922672f31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.321030 Jul 19 15:33:33.817183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 168/333] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:33 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:34.146195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:34.146862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:34.163845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.164757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.165886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.166491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.338418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:34.352840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f498409a-9f35-4ca0-b7cc-2dfe86de60d0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.213364 Jul 19 15:33:34.353557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 166/334] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:34 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:34.600312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:34.601463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:34.608897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.609387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.610327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.611374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.764073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:34.764777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:34.770318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:34.778976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c16a3404-66bc-4cd3-91d5-3c58c78372bf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.184736 Jul 19 15:33:34.779994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 169/335] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:34 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:34.793444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.794201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.795152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.798342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.832713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:34.835099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:34.843880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.844642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.847307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:34.848292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:34.890442 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:34.900099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-850ab5bf-b02c-4398-802b-6c34bea28115 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1187 microversion: 2.1 time: 0.141340 Jul 19 15:33:34.900661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 167/336] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:34 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1187 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:35.152084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:35.165281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:35.169031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:35.178207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dffbbc3e-140f-419f-a4f8-a2a990e3e5a7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.350099 Jul 19 15:33:35.181077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 170/337] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:34 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:35.371671 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:35.372587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:35.381067 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.381787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:35.382861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.383288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:35.611477 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:35.621055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8b2421d7-93a3-4706-96f4-f03f3d283b47 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.254229 Jul 19 15:33:35.632853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 168/338] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:35 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:35.829320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:35.830059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:35.846897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.847776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:35.849013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.850072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:35.919424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:35.920034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:35.929359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.930042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:35.931093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:35.931829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:36.078692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:36.094320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ce3e1881-b6e4-471f-b6e3-5a1a1b3cd46a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1205 microversion: 2.1 time: 0.179523 Jul 19 15:33:36.109532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 169/339] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:35 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1205 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:36.229516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:36.231400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:36.251967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:36.252578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:36.253300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:36.258023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:36.298384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:36.308194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-35f0b66d-d29d-4cfe-97ab-80f7eed6320d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.497213 Jul 19 15:33:36.314879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 171/340] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:35 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:36.640290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:36.641470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:36.651466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:36.652258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:36.653794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:36.654590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:36.672872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:37.414878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:37.424769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:37.431744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:37.433449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-37a8a962-9b40-45bb-833f-72fbdc966914 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 1.222636 Jul 19 15:33:37.436321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 170/341] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:36 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:37.444700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:37.452756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:37.456545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:37.462241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:37.462687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:37.463468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:37.463899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:37.487384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cc70a1f7-7109-4689-a33c-00a9854381a2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.840807 Jul 19 15:33:37.488814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 172/342] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:36 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:37.494479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:37.495680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:37.509092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:37.510240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:37.511584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:37.512248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:38.161227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.172126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d2fe4270-0c92-4a12-912c-3f876e184d86 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.681360 Jul 19 15:33:38.172954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 173/343] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:37 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:38.296652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.307157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f8bd30ef-1a6d-494d-9492-da42b1b5309c tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.869503 Jul 19 15:33:38.331623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 171/344] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:37 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:38.458501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:38.462444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:38.472834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:38.473890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:38.474921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:38.475568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:38.507660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:38.508990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:38.522226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:38.523372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:38.525551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:38.527530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:38.886772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.908979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.912714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.919158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-323bcef5-112a-44a1-bba0-001af7fcbf31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.464977 Jul 19 15:33:38.930966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:38.931730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 174/345] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:38 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:38.939493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5a5606d4-d5a5-4541-a324-753fd9263543 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.438127 Jul 19 15:33:38.950343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 172/346] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:38 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:39.202322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:39.202955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:39.213554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.214004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.214794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.215247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.280830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-f7779425-5e7a-41f7-a016-680c25bf028f req-f57422da-0542-49f3-b0c8-7ffd7d23299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:39.300851 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-f7779425-5e7a-41f7-a016-680c25bf028f req-f57422da-0542-49f3-b0c8-7ffd7d23299c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.302086 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-f7779425-5e7a-41f7-a016-680c25bf028f req-f57422da-0542-49f3-b0c8-7ffd7d23299c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.317457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-f7779425-5e7a-41f7-a016-680c25bf028f req-f57422da-0542-49f3-b0c8-7ffd7d23299c service nova] Creating event network-changed:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:33:39.323108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-f7779425-5e7a-41f7-a016-680c25bf028f req-f57422da-0542-49f3-b0c8-7ffd7d23299c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045549 Jul 19 15:33:39.324935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 173/347] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:33:39.340349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:39.341769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:39.355654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.356426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.357483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.358133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.628214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:39.643077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-22f934f5-2ea9-48aa-bab3-dfbbafa649ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.447356 Jul 19 15:33:39.644063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 175/348] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:39 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:39.708854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:39.717956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c08c1bed-c98d-4fcd-af7c-26e5a5f4157f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.382748 Jul 19 15:33:39.722827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 174/349] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:39 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:39.939166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:39.940084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:39.953596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.955030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.956053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.956710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.959042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:39.959649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:39.969031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.970394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:39.971415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:39.972009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:40.221885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:40.233235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:40.242497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:40.243785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:40.254916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-06c60164-6f0a-41cd-8b2e-223e7b773650 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.319605 Jul 19 15:33:40.255720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 176/350] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:39 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:40.256639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e16df9e2-f9c5-4d24-ba83-0c4d9dd17cb5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.302335 Jul 19 15:33:40.270197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 175/351] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:39 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:40.662170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:40.663618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:40.680368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:40.683399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:40.684221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:40.684651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:40.739279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:40.740582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:40.751187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:40.755921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:40.759754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:40.760505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:41.043636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.067640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7bf987e6-71f6-4aca-b970-ba790a2a6b95 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.411109 Jul 19 15:33:41.069290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 177/352] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:40 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:41.179482 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.187552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5ee65db4-9922-48e0-a54a-ac618b3cd4d8 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.452399 Jul 19 15:33:41.200913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 176/353] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:40 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:41.278605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:41.279160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:41.281556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:41.283379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:41.292047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:41.301188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:41.301188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:41.301188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:41.301696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:41.304516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:41.305212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:41.310551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:41.311264 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:41.543915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.559301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7ea45c2f-7e3f-494a-ae34-b77967154c3d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.284899 Jul 19 15:33:41.560253 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 177/354] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:41 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:41.617322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.643213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.645010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:41.646481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1c29e3f6-764a-4f94-95a5-7b2bcbd5c108 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.376187 Jul 19 15:33:41.647215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 178/355] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:41 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:42.085866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:42.089772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:42.098177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.100322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.101214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.101731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.208885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:42.210457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:42.223033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.224461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.226275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.228704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.367445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:42.377057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8d548704-9c60-4dee-9d77-d83b391a6e67 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.294430 Jul 19 15:33:42.382008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 178/356] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:42 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:42.509069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:42.521694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7657e7b1-8e6c-45e8-97df-a467bfd78805 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.316735 Jul 19 15:33:42.523130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 179/357] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:42 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:42.577358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:42.578141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:42.588292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.589072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.590046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.590771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.671567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:42.672366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:42.685304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.690932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.692896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:42.693489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:42.938504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:42.983955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-17ac7255-8149-4040-96e8-4d16333912aa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.410184 Jul 19 15:33:42.995549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 179/358] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:42 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:43.004476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:43.014364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:43.016880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:43.018187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0fc186dd-52f5-471a-829d-4aa62c1d36ea tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.352827 Jul 19 15:33:43.018964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 180/359] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:42 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:43.403303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:43.404046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:43.420827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:43.421398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:43.422246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:43.422802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:43.539780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:43.540364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:43.553025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.554433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:43.569767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:43.570339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:43.571242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:43.579533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:43.695227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:43.703476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b14038dd-8c7e-4045-8e21-2f34ab175964 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.308660 Jul 19 15:33:43.710156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 180/360] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:43 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:43.884991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:43.893530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ed3d41bf-25cc-4b80-870c-43660b262742 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.357997 Jul 19 15:33:43.905397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 181/361] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:43 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:44.005293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:44.006219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:44.021666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.025190 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.027205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.028529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.030021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.049542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:44.050341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:44.061487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.061951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.062781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.068275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.357233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:44.371846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:44.373630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:44.374911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3cb2e7f1-0f92-4e18-836f-286ce87f68bb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.340301 Jul 19 15:33:44.387704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 182/362] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:44 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:44.423484 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:44.425965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:44.432638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e3226ceb-4ede-4cae-8181-ac1b1a413101 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.433838 Jul 19 15:33:44.433876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 181/363] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:43 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:44.727865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:44.728525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:44.735294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.735833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.736601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.737031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.901086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:44.910230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-10a90d8d-64d2-403c-9e35-630e3274cbb2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.186288 Jul 19 15:33:44.910798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 183/364] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:44 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:44.913374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:44.914204 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:44.921359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.921807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:44.923300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:44.923809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.065422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:45.074582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e390593c-661d-492b-a08a-04911d11b5be tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.165079 Jul 19 15:33:45.075408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 182/365] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:44 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:45.394301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:45.395064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:45.401984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.402435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.403210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.403650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.450781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:45.452297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:45.474235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.475602 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.477408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.478291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.627116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:45.643790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:45.645754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:45.647046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-717b0e30-5f21-48d3-bbcd-69fb633c280e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.256902 Jul 19 15:33:45.651620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 184/366] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:45 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:45.748766 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:45.757612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b0115a8d-1d83-41c5-b417-218381588d91 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.311387 Jul 19 15:33:45.761239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 183/367] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:45 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:45.927253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:45.928390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:45.938146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.938596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:45.939369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:45.939795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.092698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:46.094447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:46.098699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:46.099025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.105569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.106334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.107710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.108022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dbdbe468-8684-4d0b-ae6b-805df9489534 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.184576 Jul 19 15:33:46.108689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.117955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 185/368] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:45 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:46.293432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.301345 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-200ec71a-4389-4955-a69c-66bfadeaa0cf tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.213560 Jul 19 15:33:46.301919 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 184/369] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:46 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:46.667954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:46.668556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:46.674673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.675124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.675885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.676319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.775196 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:46.775858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:46.783421 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.783865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.784632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:46.785064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:46.818376 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.827171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.829408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.835249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3004f37a-6a63-43e4-99f5-76154e5d4ebb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.171199 Jul 19 15:33:46.835830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 186/370] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:46 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:46.919716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:46.927275 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b5174eea-b418-46f4-b6b6-4ca1424dc8f2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.156209 Jul 19 15:33:46.927823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 185/371] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:46 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:47.127761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:47.128958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:47.135279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.136571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.137366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.137826 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.271740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:47.279380 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9cbac9ea-d46b-4036-a203-7a23fd0e55b2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1675 microversion: 2.1 time: 0.156764 Jul 19 15:33:47.279950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 187/372] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:47 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:47.319974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:47.321196 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:47.328815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.329707 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.331226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.333894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.481488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:47.489706 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f22adcbd-ea72-49f3-8d7f-45ee57dcfe36 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.175326 Jul 19 15:33:47.490351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 186/373] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:47 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:47.854199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:47.854899 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:47.861889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.862343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.863113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.863548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.955187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:47.955824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:47.963373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.963826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:47.964606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:47.966940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.201957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.210252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.220274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-02e82ea4-1c55-4ff4-a2fa-4562c8d16eee tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.278521 Jul 19 15:33:48.226933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.228770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.229943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 187/374] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:47 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:48.230159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d8eb3d10-e780-4ed5-9e77-ac8ce701a909 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.379874 Jul 19 15:33:48.230593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 188/375] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:47 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:48.295738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:48.296349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:48.308742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.309225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.310294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.310978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.459102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.467266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0404ca31-e71f-47c0-861a-eaa5fdc9e57b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1652 microversion: 2.1 time: 0.175376 Jul 19 15:33:48.468017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 188/376] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:48 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1652 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:48.486406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bfe3fccc-a838-4dfd-ad50-0703e8b432cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:48.493475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfe3fccc-a838-4dfd-ad50-0703e8b432cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.493928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfe3fccc-a838-4dfd-ad50-0703e8b432cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.496332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:48.507019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:48.507745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:48.515552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.516038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.516830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.517290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.573084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bfe3fccc-a838-4dfd-ad50-0703e8b432cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Going to try to start instance {{(pid=118007) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 15:33:48.630005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bfe3fccc-a838-4dfd-ad50-0703e8b432cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action" status: 202 len: 0 microversion: 2.1 time: 0.148560 Jul 19 15:33:48.630714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 189/377] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:33:48 2022] POST /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:33:48.639549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:48.640873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:48.649714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.650325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.651178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:48.651683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:48.687094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.695188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9a5f9027-ac72-4de3-9936-a1f571abb985 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.192255 Jul 19 15:33:48.695778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 189/378] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:48 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:48.813056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:48.820545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1d494b94-24cc-4853-85ec-b615e24925a4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1661 microversion: 2.1 time: 0.185670 Jul 19 15:33:48.821108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 190/379] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:48 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:49.237521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:49.238745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:49.244874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.246195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.247053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.247496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.258167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:49.258783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:49.267546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.267997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.268777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.269241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.567377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:49.576472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f97cee7c-0555-48e9-a4bd-553dfd35c76c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.342755 Jul 19 15:33:49.577261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 190/380] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:49 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:49.607246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:49.617186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:49.619037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:49.620713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e9493ff0-aa3c-40a5-9318-22b1a1286d25 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.376414 Jul 19 15:33:49.622379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 191/381] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:49 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:49.713124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:49.713831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:49.720047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.720432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.721255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.721692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.839565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:49.840219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:49.847568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.848036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:49.848865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:49.849488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:50.250265 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.257942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-846bbb9f-febd-4dd1-aef8-5e5885cd6eca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.548495 Jul 19 15:33:50.258818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 191/382] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:49 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:50.273969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.281386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e4f5e9b2-b51d-4198-9e6b-79e9ed3670eb tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1661 microversion: 2.1 time: 0.446561 Jul 19 15:33:50.282897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 192/383] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:49 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1661 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:50.595132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:50.595718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:50.601675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:50.602123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:50.602894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:50.603357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:50.640550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:50.641801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:50.648166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:50.648617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:50.649418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:50.649855 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:50.782567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.790063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2aa75023-3dd9-49cb-ba25-c32b5ee50296 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.200263 Jul 19 15:33:50.790634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 192/384] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:50 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:50.808773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.817664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.819156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:50.820295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93d32a07-83a1-46d5-9f92-2127df3c31d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.183653 Jul 19 15:33:50.820837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 193/385] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:50 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:51.277592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:51.278291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:51.285218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.285729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.286508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.286992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.302086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:51.303064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:51.310831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.311583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.312532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.313851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.539522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:51.544136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:51.547103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3952e024-2729-4434-a0e7-af0d7b1897cc tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1661 microversion: 2.1 time: 0.250901 Jul 19 15:33:51.548488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 194/386] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:51 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1661 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:51.552532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8beb3797-a762-4e00-951d-68ab4f66b00a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.281019 Jul 19 15:33:51.553079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 193/387] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:51 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:33:51.807390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:51.808027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:51.813994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.814430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.815178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.815605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.839178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:51.839839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:51.847029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.847599 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:51.848425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:51.849154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.001926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.009463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-569b9880-a796-402b-a59b-a6b4b44e8b4c tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1502 microversion: 2.1 time: 0.205886 Jul 19 15:33:52.010333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 195/388] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:51 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:52.024746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.026359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5b85e4e-4886-4630-9af9-f5ee93292520"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:52.027465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:52.033925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.034364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.034516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.035119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.035543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.036014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.037178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2946f249-1112-4f7f-a32c-da870a7a4a90 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.202140 Jul 19 15:33:52.037739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 194/389] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:51 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:33:52.059556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] HTTP exception thrown: Cannot 'attach_volume' instance 751332f2-549d-4fc4-91f6-7c217bb044c4 while it is in vm_state rescued Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Request method failure captured: Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/os-volume_attachments HTTP/1.1 Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 74 Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s5kjxTTWPkWpRKUKuTVlNF2k3dmirpjAJi92koCKFEFtpTmL0ovShxKBmUo6VasvyYl8dVOooHRSV7gpqVoVmmJP8pyg_Yzx00EkXiBNho-xdeVLSHUNzNZWwfnM1eRGjRqb1K7enOhS68iU4Y8ltqi36KF995_zWnV0gGrfnkiswo Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:33:52.061210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c3bc3582aa7420a9a1fcccacff362bd"}]}] Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 491d052f3d2947cea318b0753fffd1fa Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {"volumeAttachment": {"volumeId": "c5b85e4e-4886-4630-9af9-f5ee93292520"}} Jul 19 15:33:52.062946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Cannot 'attach_volume' instance 751332f2-549d-4fc4-91f6-7c217bb044c4 while it is in vm_state rescued Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'server_id': '751332f2-549d-4fc4-91f6-7c217bb044c4', 'body': {'volumeAttachment': {'volumeId': 'c5b85e4e-4886-4630-9af9-f5ee93292520'}}} Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:33:52.063973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 751332f2-549d-4fc4-91f6-7c217bb044c4 while it is in vm_state rescued Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:33:52.065405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 751332f2-549d-4fc4-91f6-7c217bb044c4 while it is in vm_state rescued Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Returning 409 to user: Cannot 'attach_volume' instance 751332f2-549d-4fc4-91f6-7c217bb044c4 while it is in vm_state rescued {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6e01d1b8-31b5-4d44-8b7b-48f0f1bcd095 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040344 Jul 19 15:33:52.066675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 196/390] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:33:52 2022] POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 19 15:33:52.071343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:52.071877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:52.078133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.079143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.079911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.080352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.147940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-92e7b59b-10e3-4927-bcc0-80e5b809da24 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/action" status: 202 len: 0 microversion: 2.1 time: 0.079922 Jul 19 15:33:52.148556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 195/391] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:33:52 2022] POST /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:33:52.157173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:52.157783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:52.163818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.164256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.165006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.165462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.293617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.301544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ac1296e-5588-47f0-a72c-6bd51a3e466a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1510 microversion: 2.1 time: 0.148381 Jul 19 15:33:52.302105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 197/392] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:52 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:52.566761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:52.567368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:52.569510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:52.570190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:52.573753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.574200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.575154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.575589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.576470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.576976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.577822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:52.578500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:52.862534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.867099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:52.870133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bac40e5a-b1d2-4c7a-8275-83bd8a162545 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1665 microversion: 2.1 time: 0.309275 Jul 19 15:33:52.870700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 196/393] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:52 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1665 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:52.874748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3cff366b-3ad5-40a3-a881-17469a39feb9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.309147 Jul 19 15:33:52.875991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 198/394] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:52 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:53.055724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:53.056386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:53.062346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.063316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:53.064271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.064709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:53.080153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:53.197076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:53.206504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:53.208013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:53.209179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bbf97d92-ece7-43e6-a304-0f24fcec2d3b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.157597 Jul 19 15:33:53.209738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 197/395] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:53 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:53.319457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:53.320059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:53.326314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.326768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:53.327528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.327962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:53.455441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:53.463030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cece5d9e-ddce-4725-8dbd-e67bc3527063 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1510 microversion: 2.1 time: 0.147444 Jul 19 15:33:53.463570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 199/396] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:53 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:53.582288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:33:53.583030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:33:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:33:53.891704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:53.892299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:53.898959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.899436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:53.900193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:53.900628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:54.058212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:54.066332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a5e0695d-40ff-4ecc-bb15-f35299d387fb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.178451 Jul 19 15:33:54.066905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 198/397] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:53 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:54.227513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:54.228148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:54.234336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:54.235956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:54.236736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:54.237192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:54.382306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:54.390767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:54.392281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:54.393455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-65e4deac-211a-4888-bb09-209c9517aa83 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.169822 Jul 19 15:33:54.394027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 200/398] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:54 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:54.479668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:54.480318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:54.487094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:54.487547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:54.488321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:54.488759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:54.631441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:54.639034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-742cdcd2-9390-4e4b-a70f-9ea8a65fe58b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1510 microversion: 2.1 time: 0.163213 Jul 19 15:33:54.639596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 199/399] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:54 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:55.083147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:55.083750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:55.089852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.090292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.091051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.091479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.219596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:55.227008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-14136129-d1df-4ced-8882-27a3899f22db tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.147775 Jul 19 15:33:55.227568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 201/400] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:55 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:55.412363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:55.412886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:55.419370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.419818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.420568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.420997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.552749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:55.561596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:55.563389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:55.564600 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5b9f6f39-5cec-4d54-9cb3-0c180d216252 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.156209 Jul 19 15:33:55.565948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 200/401] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:55 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:55.656919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:55.657578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:55.663693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.664083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.664841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:55.665311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:55.790353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:55.798433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-40eddb3e-e403-4137-9941-0b5c4e3c1323 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1510 microversion: 2.1 time: 0.145374 Jul 19 15:33:55.799002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 202/402] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:55 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:56.142135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-0834c5b9-0897-4162-b64d-c0b9960a467c req-2fd0cc22-b094-4990-8fd7-b9a338a09c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "name": "network-vif-plugged", "status": "completed", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:56.150636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0834c5b9-0897-4162-b64d-c0b9960a467c req-2fd0cc22-b094-4990-8fd7-b9a338a09c62 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.151307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0834c5b9-0897-4162-b64d-c0b9960a467c req-2fd0cc22-b094-4990-8fd7-b9a338a09c62 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.164806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-0834c5b9-0897-4162-b64d-c0b9960a467c req-2fd0cc22-b094-4990-8fd7-b9a338a09c62 service nova] Creating event network-vif-plugged:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:33:56.169677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-0834c5b9-0897-4162-b64d-c0b9960a467c req-2fd0cc22-b094-4990-8fd7-b9a338a09c62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032522 Jul 19 15:33:56.170209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 201/403] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:56.243775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:56.244369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:56.251794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.252234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.253069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.253525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.386580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:56.394100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3adcb4ac-7204-41e3-9266-dafa1d353c7b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.154184 Jul 19 15:33:56.394651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 203/404] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:56 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:56.583579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:56.584591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:56.590782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.591220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.591973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.592402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.720111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:56.728360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:56.729877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:56.731007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39e98a35-de63-427d-bb72-1e2f082e32ee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.152101 Jul 19 15:33:56.731553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 202/405] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:56 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:56.815712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:56.816316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:56.822282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.822736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.823500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:56.823933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:56.956245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:56.964045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-57e00833-fe63-4f5f-8b0c-12b4cec9a9ac tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1516 microversion: 2.1 time: 0.152466 Jul 19 15:33:56.964607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 204/406] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:56 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:57.411101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:57.411734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:57.418025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:57.418466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:57.419232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:57.419660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:57.546832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:57.555415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-aa41e2e2-2142-43d6-b5ac-5d4cc6798854 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.148180 Jul 19 15:33:57.555991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 203/407] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:57 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:57.749841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:57.750982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:57.757008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:57.757482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:57.758241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:57.758673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:57.762610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:57.890320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:57.899075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:57.900572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:57.901855 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-386912b3-5870-45c5-bda4-1129a6c4f278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.155914 Jul 19 15:33:57.902409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 205/408] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:57 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:58.292835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d112e734-8e06-45cb-a5bd-f8e683f9ddb4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: .version_select at 0x7f8322d3c0d0>, body: {"keypair": {"name": "tempest-keypair-1372700082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPrmY3hfCaN3KT4HY6tRGeFsIpwwu5dxU2QDlAy47J3e8s/em45oXReupHMw3an2SP7tvfzq3YnnbYJDEwVH5Mjiq787Ht3Vz/R+LFHgT9i82nZuwABi4uz9pLgQ319Jg=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:33:58.307624 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-d112e734-8e06-45cb-a5bd-f8e683f9ddb4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:33:58.311436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-d112e734-8e06-45cb-a5bd-f8e683f9ddb4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for user 491d052f3d2947cea318b0753fffd1fa and project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:33:58.335838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d112e734-8e06-45cb-a5bd-f8e683f9ddb4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046836 Jul 19 15:33:58.336428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 204/409] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:33:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:33:58.572483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:58.573529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:58.581053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:58.581639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:58.582544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:58.582968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:58.778872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:58.786682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-454ee477-6b87-48ef-b053-85f3559ea837 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.218445 Jul 19 15:33:58.787458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 206/410] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:58 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:58.919986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:58.920757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:58.927774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:58.928229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:58.929008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:58.929478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:59.120743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:59.129244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:59.130725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:59.131878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-515bcf8a-4740-4900-a2da-01adec6d5b4d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.215970 Jul 19 15:33:59.132426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 205/411] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:33:58 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:33:59.804031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:33:59.804698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:33:59.811102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:59.811543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:59.812305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:33:59.813035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:33:59.963387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:33:59.971122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-046d74c9-2b13-4a9f-a844-0cec08b0fa0a tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.170910 Jul 19 15:33:59.972014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 207/412] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:33:59 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:33:59.998509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1411150425", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64a3dd77-0154-437f-a110-1bf7cbe9008a"}], "security_groups": [{"name": "tempest-securitygroup--1889180178"}], "key_name": "tempest-keypair-1372700082", "user_data": "}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:00.113826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] validate_networks() for [('64a3dd77-0154-437f-a110-1bf7cbe9008a', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:34:00.152735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:00.153925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:00.172307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.173268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.174505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.174956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.413744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:00.422939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:00.424550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:00.425844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d63437a8-790b-48f7-a049-f60a1abb7651 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1806 microversion: 2.20 time: 0.279223 Jul 19 15:34:00.426492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 208/413] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:00 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:00.431539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-e724cb2a-3eb2-4976-82a7-7be336356f26 req-f634401b-15ef-458d-bf61-afb5384a9d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "name": "network-vif-plugged", "status": "completed", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:00.440954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e724cb2a-3eb2-4976-82a7-7be336356f26 req-f634401b-15ef-458d-bf61-afb5384a9d49 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.441505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e724cb2a-3eb2-4976-82a7-7be336356f26 req-f634401b-15ef-458d-bf61-afb5384a9d49 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.454025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-e724cb2a-3eb2-4976-82a7-7be336356f26 req-f634401b-15ef-458d-bf61-afb5384a9d49 service nova] Creating event network-vif-plugged:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:34:00.459707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-e724cb2a-3eb2-4976-82a7-7be336356f26 req-f634401b-15ef-458d-bf61-afb5384a9d49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Jul 19 15:34:00.460254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 209/414] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:00.624509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:34:00.625630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:34:00.626212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:34:00.626722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:34:00.627837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:34:00.639624 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.640199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.642008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.643271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.675493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:00.680624 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Getting quotas for user 491d052f3d2947cea318b0753fffd1fa and project 8c3bc3582aa7420a9a1fcccacff362bd. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:00.692627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:34:00.695023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:34:00.748799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-91a6240b-bada-4969-93d4-b65b9e16ca95 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.754519 Jul 19 15:34:00.751078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 206/415] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:33:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:34:00.762124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d8d5a3fc-47d0-41fe-a79f-a95b7e57a7e6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:00.762874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d8d5a3fc-47d0-41fe-a79f-a95b7e57a7e6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:00.847024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d8d5a3fc-47d0-41fe-a79f-a95b7e57a7e6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:00.856435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d8d5a3fc-47d0-41fe-a79f-a95b7e57a7e6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1246 microversion: 2.1 time: 0.099279 Jul 19 15:34:00.857013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 210/416] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:00 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:00.989197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:00.989799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:00.995954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.996397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:00.997397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:00.997827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:01.147298 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:01.158911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-983f9a8c-3914-4dcf-991a-013ed08b19c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.174533 Jul 19 15:34:01.168399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 207/417] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:00 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:01.444889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:01.445428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:01.451619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:01.452072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:01.452837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:01.453493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:01.581630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:01.589985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:01.591475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:01.592616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-053e22d2-d7b5-49bf-85dd-9d59eb55d68e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1793 microversion: 2.20 time: 0.151824 Jul 19 15:34:01.593251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 211/418] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:01 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1793 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:01.873825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:01.874436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:01.880954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:01.881436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:01.882205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:01.882641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:01.948625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:01.956606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dbc7f5ce-e542-4e36-8d5d-611f1f071fd8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1298 microversion: 2.1 time: 0.086649 Jul 19 15:34:01.957173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 208/419] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:01 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:02.175953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:02.176489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.182600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.183047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.183806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.184240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.320618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:02.328774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0c65ec5a-8e41-4075-8d4c-b87a7fcc7706 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1259 microversion: 2.1 time: 0.156136 Jul 19 15:34:02.329386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 212/420] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:02 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:02.431186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:02.431705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.438665 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.439108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.439857 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.440284 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.462539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a099b0a2-4b74-41d8-abb4-fba827039469 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/ips" status: 200 len: 149 microversion: 2.1 time: 0.035235 Jul 19 15:34:02.463086 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 209/421] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:34:02 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:02.474176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:02.475312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.481309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.481742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.482496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.482923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.564970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: POST /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/os-volume_attachments HTTP/1.1 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 74 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:34:02.566804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {"volumeAttachment": {"volumeId": "0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e"}} Jul 19 15:34:02.568278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'server_id': 'd8f4a1ee-aa79-4dad-917e-ba073bdbc3da', 'body': {'volumeAttachment': {'volumeId': '0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e'}}} Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:02.569099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:02.570452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 400 to user: Invalid volume: volume 0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e is already attached to instances: 9d78f8e2-17a7-4eb3-852f-369ee03e3630 {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fcd998ea-9419-4418-a1be-a11dd12aac7d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098250 Jul 19 15:34:02.571843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 213/422] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:34:02 2022] POST /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:34:02.577249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:02.577738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.583803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.584245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.585028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.585486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.610293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:34:02.685697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e59ac872-ba35-4726-81b6-d43996a41844 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 204 len: 0 microversion: 2.1 time: 0.111903 Jul 19 15:34:02.686191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 210/423] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:34:02 2022] DELETE /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:34:02.694634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:02.695261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.702100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.702540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.703301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.703961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.830255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:02.837540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3ed12f63-9dd8-43b2-9332-a9206571e14d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1681 microversion: 2.1 time: 0.146721 Jul 19 15:34:02.838099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 214/424] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:02 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:02.973900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:02.974715 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:02.980893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.981456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:02.982302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:02.982833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.057780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:03.067214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-085a478a-4038-4a51-ac87-10aa8d7299c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1306 microversion: 2.1 time: 0.097430 Jul 19 15:34:03.067791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 211/425] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:02 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:03.345408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:03.346027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:03.351981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.352421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.353193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.353624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.491011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:03.498383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-56d354d1-3e4f-4b1d-bcb3-170ec3ef9a32 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1443 microversion: 2.1 time: 0.157035 Jul 19 15:34:03.498934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 215/426] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:03 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:03.514726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:03.515272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:03.521589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.522294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.523053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.523481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.651806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:03.659171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1c28cbb3-854c-4409-9808-8325e74f0ebe tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1443 microversion: 2.1 time: 0.148278 Jul 19 15:34:03.659733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 212/427] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:03 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:03.855942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:03.856671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:03.863392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.863841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:03.864616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:03.865054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:04.083981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:04.084548 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:04.090559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:04.091003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:04.091769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:04.092200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:04.105974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:04.114222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0cf15d25-846d-463f-998f-afc44d733696 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1681 microversion: 2.1 time: 0.262218 Jul 19 15:34:04.115085 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 216/428] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:03 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1681 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:04.181942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:04.189257 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-24e34f87-205d-4720-adee-0e3727bf1151 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1306 microversion: 2.1 time: 0.109178 Jul 19 15:34:04.189818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:04 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1306 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:05.131775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:05.132319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:05.138386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:05.138843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:05.139578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:05.140005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:05.205358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:05.206057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:05.212865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:05.213347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:05.214112 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:05.214539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:05.398612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:05.406742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-12072cf8-488d-42e5-9d74-fdcbedbb6ad1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1304 microversion: 2.1 time: 0.205174 Jul 19 15:34:05.407335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 214/430] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:05 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:05.863237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:05.870690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fa3958e0-62a8-41fa-8318-92a065fd8ed4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1681 microversion: 2.1 time: 0.742819 Jul 19 15:34:05.871257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 217/431] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:05 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1681 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:06.424800 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:06.425478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:06.433828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:06.434732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:06.435742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:06.436509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:06.441572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:06.831913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:06.839105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5ae17707-c440-434c-b93a-ae4dc42928c2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.419137 Jul 19 15:34:06.839680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 215/432] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:06 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:06.890646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:06.891813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:06.898440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:06.898883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:06.899650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:06.900083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:07.012432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:07.021252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8e04ec3c-717d-421c-ad45-af6adcdf36e0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1614 microversion: 2.1 time: 0.135054 Jul 19 15:34:07.022073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 218/433] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:06 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:07.527580 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-4750101b-a442-4bc5-8c5a-d04bea1df734 req-dc7be06d-b93c-4da5-afcd-142b94f0b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8f4a1ee-aa79-4dad-917e-ba073bdbc3da", "name": "network-vif-deleted", "tag": "d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:07.552193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-4750101b-a442-4bc5-8c5a-d04bea1df734 req-dc7be06d-b93c-4da5-afcd-142b94f0b497 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:07.552927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-4750101b-a442-4bc5-8c5a-d04bea1df734 req-dc7be06d-b93c-4da5-afcd-142b94f0b497 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:07.579418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-4750101b-a442-4bc5-8c5a-d04bea1df734 req-dc7be06d-b93c-4da5-afcd-142b94f0b497 service nova] Creating event network-vif-deleted:d2146ae0-1f8b-48f3-b6bd-07e11b8b9d60 for instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da on hv-cinder-84984 Jul 19 15:34:07.585888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-4750101b-a442-4bc5-8c5a-d04bea1df734 req-dc7be06d-b93c-4da5-afcd-142b94f0b497 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067585 Jul 19 15:34:07.587325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 216/434] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:07.857762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:07.858464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:07.870947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:07.871479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:07.872323 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:07.874133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:08.043159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:08.043873 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:08.060598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:08.061555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:08.062435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:08.062876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:08.119500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:08.122210 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:08.122860 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:08.123586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lazy-loading 'fault' on Instance uuid d8f4a1ee-aa79-4dad-917e-ba073bdbc3da {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:34:08.300371 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:08.313173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c2306b3b-bf40-486c-b573-0b5cea477de8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 200 len: 1332 microversion: 2.1 time: 0.276585 Jul 19 15:34:08.314505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 217/435] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:08 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 1332 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:08.386362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:08.399116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6cccae8c-bd45-4b77-a5f0-0f3feeedfa38 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.545339 Jul 19 15:34:08.403997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 219/436] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:07 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:09.331742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:09.332350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:09.338584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:09.339034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:09.339829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:09.340258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:09.355407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da HTTP/1.1 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:34:09.357016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:34:09.358490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'd8f4a1ee-aa79-4dad-917e-ba073bdbc3da'} Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:34:09.359288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:34:09.360469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:34:09.361557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:34:09.361557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-46e3aec4-b8ca-4862-b370-aa8dc6e165a0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 404 len: 111 microversion: 2.1 time: 0.031398 Jul 19 15:34:09.361557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 218/437] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:09 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:09.367354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9a076336-1fe5-4ec9-ac3e-6dfedd5e2f4f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '.version_select at 0x7f832814b670>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:09.385609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9a076336-1fe5-4ec9-ac3e-6dfedd5e2f4f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381261228" status: 202 len: 0 microversion: 2.1 time: 0.022010 Jul 19 15:34:09.386146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 220/438] 10.222.0.42 () {58 vars in 1220 bytes} [Tue Jul 19 15:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1381261228 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:34:09.420781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:09.421773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:09.427983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:09.428433 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:09.429235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:09.429678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:09.599962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:09.608396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bb74fa75-a1fe-4815-8454-52f737963b71 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.191392 Jul 19 15:34:09.609846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 219/439] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:09 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:09.645053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}, {"name": "network-changed", "server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:09.661829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:09.662269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:09.675919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] Creating event network-changed:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:34:09.676440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] Creating event network-changed:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:34:09.683841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-3ca7c7c0-7ec3-499d-b21c-2454fede8699 req-94cb489f-c7b4-445d-b3d4-6be7099456a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044552 Jul 19 15:34:09.685413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 221/440] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:34:10.130886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:10.131722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:10.137976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.138501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.139466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.139934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.232655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lazy-loading 'services' on Instance uuid 9d78f8e2-17a7-4eb3-852f-369ee03e3630 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:34:10.313235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b60d2100-be13-4035-84f9-105701a59365 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments/0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e" status: 202 len: 0 microversion: 2.1 time: 0.186070 Jul 19 15:34:10.314038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 220/441] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:34:10 2022] DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments/0ebe742b-e4ee-4a02-b085-c0df2bf8cb0e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:34:10.323678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:10.325030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:10.332428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.333080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.334196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.335001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.365459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-393aac80-c7c7-4d6a-8737-c9698961e623 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045857 Jul 19 15:34:10.365928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 222/442] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:34:10 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:10.627680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:10.628323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:10.634582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.635033 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.635810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:10.636531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:10.655303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:10.688064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=10 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:10.796766 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:10.804285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-60959901-2f18-42a3-abc4-04e5b84df051 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.182092 Jul 19 15:34:10.804870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 221/443] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:10 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:11.377618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:11.378540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:11.380598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.381475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:11.389188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.389637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.391157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.391468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.422104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b47c2ed2-9b91-4490-8740-9b1ddf9bc76f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048698 Jul 19 15:34:11.422675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 223/444] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:34:11 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:34:11.480343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:11.480830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:11.487341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.487787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.489194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.489629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.513622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:34:11.590187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4d0c6df9-62e8-4b56-bb91-fe6301a20f1d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 204 len: 0 microversion: 2.1 time: 0.113356 Jul 19 15:34:11.590861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 222/445] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:34:11 2022] DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:34:11.600906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:11.601946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:11.608317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.609093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.609894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.610340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.744216 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:11.752476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-18c0d883-d080-4d5b-883b-c5c37f843fa4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1681 microversion: 2.1 time: 0.156179 Jul 19 15:34:11.752920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 224/446] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:11 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:11.822228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:11.822937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:11.830152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.830592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.831381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:11.831805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:11.962062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:11.969626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a0c05793-d0f7-4e3a-80cb-a5a5ea7b98da tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.151532 Jul 19 15:34:11.970185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 223/447] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:11 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:12.218317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-834ab59a-a5c3-49b3-8b47-40d70ffdb405 req-b9fd115c-1fab-4429-b7bc-c7529c6d1f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "name": "network-vif-plugged", "status": "completed", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:12.226291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-834ab59a-a5c3-49b3-8b47-40d70ffdb405 req-b9fd115c-1fab-4429-b7bc-c7529c6d1f7a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:12.226730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-834ab59a-a5c3-49b3-8b47-40d70ffdb405 req-b9fd115c-1fab-4429-b7bc-c7529c6d1f7a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:12.229281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:12.239692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-834ab59a-a5c3-49b3-8b47-40d70ffdb405 req-b9fd115c-1fab-4429-b7bc-c7529c6d1f7a service nova] Creating event network-vif-plugged:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:34:12.244503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-834ab59a-a5c3-49b3-8b47-40d70ffdb405 req-b9fd115c-1fab-4429-b7bc-c7529c6d1f7a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029806 Jul 19 15:34:12.245188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 225/448] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:12.770233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:12.770837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:12.777260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:12.777711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:12.778471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:12.778905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:12.910954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:12.918328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3f14a394-982b-47c4-bb83-06cbbc1f7886 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1681 microversion: 2.1 time: 0.151936 Jul 19 15:34:12.918898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 224/449] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:12 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:12.987312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:12.988014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:12.994164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:12.994603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:12.995355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:12.995777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:13.129827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:13.138131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-385990f6-5b10-4a6e-a279-a719020a6bb6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.155330 Jul 19 15:34:13.138881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 226/450] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:12 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:13.935688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:13.936285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:13.944511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:13.945260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:13.946340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:13.947522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:14.050997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:14.059507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cb27eac7-0e6e-4fc7-9444-7b67444b7e75 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1613 microversion: 2.1 time: 0.127581 Jul 19 15:34:14.060079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 225/451] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:13 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:14.156505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:14.157118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:14.163210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:14.163660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:14.164442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:14.164885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:14.336113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-4886415d-befe-4431-afcf-a4ca68513f5b req-7e2e1979-419c-4589-82c4-6be592431ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d78f8e2-17a7-4eb3-852f-369ee03e3630", "name": "network-vif-deleted", "tag": "8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:14.347776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-4886415d-befe-4431-afcf-a4ca68513f5b req-7e2e1979-419c-4589-82c4-6be592431ae1 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:14.348637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-4886415d-befe-4431-afcf-a4ca68513f5b req-7e2e1979-419c-4589-82c4-6be592431ae1 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:14.361756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-4886415d-befe-4431-afcf-a4ca68513f5b req-7e2e1979-419c-4589-82c4-6be592431ae1 service nova] Creating event network-vif-deleted:8c9a1827-c456-4aa1-88c4-cfb4b5ef0ff6 for instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 on hv-cinder-84984 Jul 19 15:34:14.367310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:14.368845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-4886415d-befe-4431-afcf-a4ca68513f5b req-7e2e1979-419c-4589-82c4-6be592431ae1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Jul 19 15:34:14.369506 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 226/452] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:14.385330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-021077d7-30a8-4bad-890b-2f085d0d096f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1372 microversion: 2.1 time: 0.233121 Jul 19 15:34:14.386471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 227/453] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:14 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:15.079798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:15.080393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:15.087156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.087607 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.088380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.088813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.121816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.122253 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.122726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lazy-loading 'fault' on Instance uuid 9d78f8e2-17a7-4eb3-852f-369ee03e3630 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:34:15.166099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:15.173970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bf8b746f-0260-40e3-bcb4-b4eaad84f5f4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 200 len: 1331 microversion: 2.1 time: 0.100580 Jul 19 15:34:15.174728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 227/454] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:15 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:15.403758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:15.404456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:15.410803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.411327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.412169 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.412599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.542276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:15.550953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4b6654f4-d6a8-4c31-b064-11f02d764aa3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1566 microversion: 2.1 time: 0.150571 Jul 19 15:34:15.551535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 228/455] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:15 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:15.568229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:15.569952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:15.580338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.580741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.581598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:15.582034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:15.668775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-854a9e4a-7fcf-4aa3-8f6d-314f698339a5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104494 Jul 19 15:34:15.669434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 228/456] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:34:15 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:16.191445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:16.191951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:16.197909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:16.198349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:16.199109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:16.199531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:16.212998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 HTTP/1.1 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:34:16.214683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:34:16.216306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '9d78f8e2-17a7-4eb3-852f-369ee03e3630'} Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:34:16.217276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:34:16.219246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:16.220523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:34:16.220523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dcd01500-25d5-4a9a-9010-7c504fab40c5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 404 len: 111 microversion: 2.1 time: 0.028688 Jul 19 15:34:16.220523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 229/457] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:16 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:16.229784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a2bbf80e-b700-410f-b146-4f4d6a2f47d8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '.version_select at 0x7f8328010310>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:16.255975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a2bbf80e-b700-410f-b146-4f4d6a2f47d8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683985719" status: 202 len: 0 microversion: 2.1 time: 0.030417 Jul 19 15:34:16.256559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 229/458] 10.222.0.42 () {58 vars in 1217 bytes} [Tue Jul 19 15:34:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683985719 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:34:16.836300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-cecc6268-e522-474f-b419-37e80532559d req-574ba24e-8496-48d6-ab5a-c4bdf6b04fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:16.845951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-cecc6268-e522-474f-b419-37e80532559d req-574ba24e-8496-48d6-ab5a-c4bdf6b04fcd service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:16.846733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-cecc6268-e522-474f-b419-37e80532559d req-574ba24e-8496-48d6-ab5a-c4bdf6b04fcd service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:16.859100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-cecc6268-e522-474f-b419-37e80532559d req-574ba24e-8496-48d6-ab5a-c4bdf6b04fcd service nova] Creating event network-changed:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:34:16.864947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-cecc6268-e522-474f-b419-37e80532559d req-574ba24e-8496-48d6-ab5a-c4bdf6b04fcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031599 Jul 19 15:34:16.865654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 230/459] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:16.920096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-396e17d2-09ef-4fad-8ee5-fc8ea22e5785 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: .version_select at 0x7f8322ce1ca0>, body: {"keypair": {"name": "tempest-keypair-42653525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXcvpW6UtAmxfnOClLveTdagUGlIOp6bUDzSpUFYGlyt1631TGNR5l1HkKipgySe0Mtwpw/EJsOhF3yfBydhyzPBwHbWs8bTB4xNpKSrMtnHzs+D7WESYZe2hT5TLNSIQ=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:16.935964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-396e17d2-09ef-4fad-8ee5-fc8ea22e5785 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:16.940430 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-396e17d2-09ef-4fad-8ee5-fc8ea22e5785 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:16.964830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-396e17d2-09ef-4fad-8ee5-fc8ea22e5785 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048550 Jul 19 15:34:16.971445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 230/460] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:34:16 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:18.443557 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-324115196", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc814b7d-034a-42a8-85dc-8ab08a546a8c"}], "security_groups": [{"name": "tempest-securitygroup--229230410"}], "key_name": "tempest-keypair-42653525", "user_data": "}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:18.548104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] validate_networks() for [('fc814b7d-034a-42a8-85dc-8ab08a546a8c', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:34:18.905957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:34:18.906371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:34:18.906879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:34:18.907311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:34:18.907716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:34:18.916424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:18.916860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:18.917675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:18.918105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:18.934931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:18.938983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:18.949714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:34:18.952547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:34:18.996529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7d61132d-a5fc-4218-ab54-051c0bd4349c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.557646 Jul 19 15:34:18.997181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 231/461] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:34:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:34:19.007866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-42e10f25-9931-49a5-b9a4-712dc18c17db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:19.008603 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-42e10f25-9931-49a5-b9a4-712dc18c17db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:19.062248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-42e10f25-9931-49a5-b9a4-712dc18c17db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:19.068960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-42e10f25-9931-49a5-b9a4-712dc18c17db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1239 microversion: 2.1 time: 0.065580 Jul 19 15:34:19.069560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 231/462] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:19 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:20.087053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:20.087657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:20.094672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:20.095089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:20.095982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:20.096464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:20.188546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:20.197106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-602c1ed1-6d6d-4c4c-a30f-369612b5e9b4 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1299 microversion: 2.1 time: 0.113988 Jul 19 15:34:20.197898 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 232/463] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:20 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:21.214082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:21.214691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:21.221687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:21.222136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:21.222926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:21.223359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:21.524003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:21.532098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dfbd3a11-aff3-4075-96f6-a510c47d2a8e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.321933 Jul 19 15:34:21.532663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 232/464] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:21 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:22.049023 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-1b445d17-eecc-4928-9fa3-7bf7749bc37b req-0c81a479-d3e1-4261-b688-8ab7289062d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a25fda1-2381-4002-9308-d8ee3a03382c", "tag": "acfedf94-bc10-4604-ab68-83a78472ec10"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:22.059910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-1b445d17-eecc-4928-9fa3-7bf7749bc37b req-0c81a479-d3e1-4261-b688-8ab7289062d6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:22.060389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-1b445d17-eecc-4928-9fa3-7bf7749bc37b req-0c81a479-d3e1-4261-b688-8ab7289062d6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:22.081009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-1b445d17-eecc-4928-9fa3-7bf7749bc37b req-0c81a479-d3e1-4261-b688-8ab7289062d6 service nova] Creating event network-changed:acfedf94-bc10-4604-ab68-83a78472ec10 for instance 3a25fda1-2381-4002-9308-d8ee3a03382c on hv-cinder-84984 Jul 19 15:34:22.090724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-1b445d17-eecc-4928-9fa3-7bf7749bc37b req-0c81a479-d3e1-4261-b688-8ab7289062d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044705 Jul 19 15:34:22.091995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 233/465] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:22.549763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:22.550273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:22.556651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:22.557093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:22.557877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:22.558305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:22.685863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:22.693755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-13724105-bcee-4fe8-9ce4-b64a48d3b87f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.148529 Jul 19 15:34:22.694304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 233/466] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:22 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:23.711139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:23.711737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:23.717883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:23.718329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:23.719437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:23.719532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:24.166865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:24.175201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-42dc171e-dd9a-40e1-a8f7-be0dc5d384ee tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.468314 Jul 19 15:34:24.175772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 234/467] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:23 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:25.191944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:25.192539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:25.199055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:25.199498 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:25.200249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:25.200677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:25.203407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:25.336308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:25.344375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b52441e9-16b2-4323-ad6d-ef73990f735c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.156327 Jul 19 15:34:25.344936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 234/468] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:25 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:26.362594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:26.363192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:26.369569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:26.370014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:26.370794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:26.371226 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:26.521689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:26.529608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9edcd8e9-7638-4c8d-a731-d78f087bad31 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.172245 Jul 19 15:34:26.530798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 235/469] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:26 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:27.548312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:27.548844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:27.555220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:27.555665 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:27.556702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:27.557183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:27.687345 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:27.695089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5818ad28-b27b-4bf4-8564-94c77c3cf204 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.151512 Jul 19 15:34:27.695650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 235/470] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:27 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:28.314163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-ddaff03b-bb14-4eb5-b812-37bad290a326 req-ed6065a4-0b45-40c9-a168-2e4162392d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a25fda1-2381-4002-9308-d8ee3a03382c", "name": "network-vif-plugged", "status": "completed", "tag": "acfedf94-bc10-4604-ab68-83a78472ec10"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:28.322802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ddaff03b-bb14-4eb5-b812-37bad290a326 req-ed6065a4-0b45-40c9-a168-2e4162392d82 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:28.323258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ddaff03b-bb14-4eb5-b812-37bad290a326 req-ed6065a4-0b45-40c9-a168-2e4162392d82 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:28.335821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-ddaff03b-bb14-4eb5-b812-37bad290a326 req-ed6065a4-0b45-40c9-a168-2e4162392d82 service nova] Creating event network-vif-plugged:acfedf94-bc10-4604-ab68-83a78472ec10 for instance 3a25fda1-2381-4002-9308-d8ee3a03382c on hv-cinder-84984 Jul 19 15:34:28.340622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-ddaff03b-bb14-4eb5-b812-37bad290a326 req-ed6065a4-0b45-40c9-a168-2e4162392d82 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 Jul 19 15:34:28.341720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 236/471] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:28.711969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:28.712578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:28.719022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:28.719466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:28.720231 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:28.720665 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:28.850132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:28.857460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-be2230d0-28b4-4c9d-9b1d-08a17548dffe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.149334 Jul 19 15:34:28.858516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 236/472] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:28 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:29.872143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:29.872922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:29.878137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:29.878822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:29.885900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:29.886343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:29.887102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:29.887530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:30.016238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:30.023835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-693deb29-e7b1-4b8b-9f0c-56b6597c35d0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1364 microversion: 2.1 time: 0.152694 Jul 19 15:34:30.024395 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 237/473] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:29 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:31.039907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:31.040581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:31.042436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:31.048341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:31.048789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:31.049587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:31.050022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:31.181127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:31.189068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dd5afaad-1ea2-46a6-8597-6a9b9713f3c9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1554 microversion: 2.1 time: 0.153019 Jul 19 15:34:31.189661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 237/474] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:31 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:31.205401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:31.205941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:31.211856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:31.212297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:31.213056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:31.213514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:31.293881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fa08e686-1d78-484f-80a6-29dbb4e6c86d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092635 Jul 19 15:34:31.294468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 238/475] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:34:31 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:32.432610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-604fbcf0-9f7e-4741-b124-e576048b9f8f req-15d34d42-fc9b-45fb-a56f-393bf0dd9f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a25fda1-2381-4002-9308-d8ee3a03382c", "tag": "acfedf94-bc10-4604-ab68-83a78472ec10"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:32.441020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-604fbcf0-9f7e-4741-b124-e576048b9f8f req-15d34d42-fc9b-45fb-a56f-393bf0dd9f85 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:32.441490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-604fbcf0-9f7e-4741-b124-e576048b9f8f req-15d34d42-fc9b-45fb-a56f-393bf0dd9f85 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:32.452881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-604fbcf0-9f7e-4741-b124-e576048b9f8f req-15d34d42-fc9b-45fb-a56f-393bf0dd9f85 service nova] Creating event network-changed:acfedf94-bc10-4604-ab68-83a78472ec10 for instance 3a25fda1-2381-4002-9308-d8ee3a03382c on hv-cinder-84984 Jul 19 15:34:32.457963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-604fbcf0-9f7e-4741-b124-e576048b9f8f req-15d34d42-fc9b-45fb-a56f-393bf0dd9f85 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028914 Jul 19 15:34:32.458738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 238/476] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:42.324476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:42.325255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=57 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:42.329919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:42.330835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:42.337908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.338353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.339110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.339543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.368362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ac5389ce-d2c3-49e5-8ab2-cf348c5de013 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044724 Jul 19 15:34:42.368904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 239/477] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:34:42 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:34:42.426529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:42.427097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:42.429218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:42.435188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.436124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.437015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.437475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.463905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:34:42.538180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b2ef44ba-39d1-49b8-8969-2ac868cf16c6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 204 len: 0 microversion: 2.1 time: 0.115475 Jul 19 15:34:42.538774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 239/478] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:34:42 2022] DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:34:42.547878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:42.549353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:42.556302 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.556799 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.557608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:42.558111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:42.685018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:42.693086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f2efa87f-48c7-438f-a7a9-8a75c9a08054 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1671 microversion: 2.1 time: 0.149848 Jul 19 15:34:42.693667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 240/479] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:42 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:43.610502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:43.611065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:43.617545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.617986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.618739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.619163 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.647877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5ccd91f4-4bbd-4ac7-9916-7a56d3c354c0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments/ad7cbfd7-fb7d-4361-9ffb-087fea3f852b" status: 200 len: 194 microversion: 2.20 time: 0.041759 Jul 19 15:34:43.648369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 240/480] 10.222.0.42 () {60 vars in 1453 bytes} [Tue Jul 19 15:34:43 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments/ad7cbfd7-fb7d-4361-9ffb-087fea3f852b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:34:43.709024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:43.709587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:43.710401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:43.711008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:43.715539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.716062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.717654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.717905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.718154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.718561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.718913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.719341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.844223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lazy-loading 'services' on Instance uuid 6130f510-2f0f-4e30-9256-e9e1e590d9a7 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:34:43.850717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:43.858311 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-338c6785-e290-40b7-91b6-362e4271622a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1671 microversion: 2.1 time: 0.151637 Jul 19 15:34:43.858874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 241/481] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:43 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:43.958282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-57266ecb-ce46-49d5-8f50-55723ed9ccee tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments/ad7cbfd7-fb7d-4361-9ffb-087fea3f852b" status: 202 len: 0 microversion: 2.20 time: 0.253256 Jul 19 15:34:43.958869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 241/482] 10.222.0.42 () {60 vars in 1456 bytes} [Tue Jul 19 15:34:43 2022] DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments/ad7cbfd7-fb7d-4361-9ffb-087fea3f852b => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:34:43.967304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:43.968350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:43.974554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.975025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:43.975817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:43.976272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:44.005626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39fb6136-3673-444a-bb82-31ff5d829e7c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042263 Jul 19 15:34:44.006172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 242/483] 10.222.0.42 () {60 vars in 1342 bytes} [Tue Jul 19 15:34:43 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:34:44.876952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:44.877776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:44.884158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:44.884603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:44.885379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:44.885812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:45.017290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:45.017702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:45.018659 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:45.025010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8288df7f-5e24-4d68-861e-5fb228bc2d53 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1671 microversion: 2.1 time: 0.153413 Jul 19 15:34:45.025522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:45.025646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 242/484] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:44 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:45.025976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:45.026746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:45.027182 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:45.056832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-aa5906ed-6d96-4cd5-8770-ce6f1cbaf684 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043418 Jul 19 15:34:45.057488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 243/485] 10.222.0.42 () {60 vars in 1342 bytes} [Tue Jul 19 15:34:45 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:34:46.042093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:46.042802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:46.049447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.049974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.050810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.051308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.069806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:46.070789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:46.084704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.085170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.086154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.086593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.121081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-087cc779-7f06-41ea-a91c-9d3880e88363 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054199 Jul 19 15:34:46.124316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 244/486] 10.222.0.42 () {60 vars in 1342 bytes} [Tue Jul 19 15:34:46 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:46.141432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-e4173f13-2b6c-4eaf-b6fc-3da973d41907 req-64cc7ed7-0c50-43ea-a417-35083b61faa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6448684-07a9-4238-bcd7-8b1f4620d268", "name": "network-vif-deleted", "tag": "8be689cb-9892-4bb4-bab2-3ee46f50f000"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:46.144615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:46.151019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e4173f13-2b6c-4eaf-b6fc-3da973d41907 req-64cc7ed7-0c50-43ea-a417-35083b61faa0 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.151828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e4173f13-2b6c-4eaf-b6fc-3da973d41907 req-64cc7ed7-0c50-43ea-a417-35083b61faa0 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.161375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f445bc33-9609-45d5-a85d-3efd7cc4b55a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1604 microversion: 2.1 time: 0.123010 Jul 19 15:34:46.171876 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 243/487] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:46 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:46.177791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-e4173f13-2b6c-4eaf-b6fc-3da973d41907 req-64cc7ed7-0c50-43ea-a417-35083b61faa0 service nova] Creating event network-vif-deleted:8be689cb-9892-4bb4-bab2-3ee46f50f000 for instance a6448684-07a9-4238-bcd7-8b1f4620d268 on hv-cinder-84984 Jul 19 15:34:46.190310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-e4173f13-2b6c-4eaf-b6fc-3da973d41907 req-64cc7ed7-0c50-43ea-a417-35083b61faa0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052819 Jul 19 15:34:46.190868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 245/488] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:46.208001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:46.208776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:46.215628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.216171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.217237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.217843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.257256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:34:46.343208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-86fb47ae-850b-4759-91c7-d5215f403186 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 204 len: 0 microversion: 2.20 time: 0.138815 Jul 19 15:34:46.344349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 244/489] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Jul 19 15:34:46 2022] DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 15:34:46.353226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:46.353903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:46.360398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.360859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.361708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:46.362153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:46.495958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:46.504609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:46.506147 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:46.507304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-436973e5-e80f-48e4-9e23-b8827d7ba986 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.158503 Jul 19 15:34:46.507864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 246/490] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:46 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:47.179396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:47.180017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:47.186366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:47.186816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:47.187595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:47.188040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:47.221460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:47.221910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:47.222366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lazy-loading 'fault' on Instance uuid a6448684-07a9-4238-bcd7-8b1f4620d268 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:34:47.266615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:47.274579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0a539ba-7529-4cb3-beba-141c6c1309f0 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 200 len: 1326 microversion: 2.1 time: 0.099431 Jul 19 15:34:47.275152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 245/491] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:47 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:47.528801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:47.530219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:47.536820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:47.537317 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:47.538100 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:47.538533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:47.669561 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:47.677907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:47.679430 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:47.680575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6aa73184-05c7-4d95-b93f-2c56dc725713 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.155686 Jul 19 15:34:47.681125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 247/492] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:47 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:48.291910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:48.292506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:48.299012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:48.299454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:48.300212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:48.300643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:48.316513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 HTTP/1.1 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:34:48.318248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:34:48.319863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'a6448684-07a9-4238-bcd7-8b1f4620d268'} Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:34:48.320846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:34:48.322386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:48.323775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:34:48.323775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-63f032c0-82f4-477b-95a0-cad7ec56835d tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 404 len: 111 microversion: 2.1 time: 0.031579 Jul 19 15:34:48.323775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 246/493] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:48 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:34:48.328623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c8a930c7-22ff-4621-a8c6-3b8cc1b4cfc2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '.version_select at 0x7f8322d4bc10>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:48.344980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c8a930c7-22ff-4621-a8c6-3b8cc1b4cfc2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170539260" status: 202 len: 0 microversion: 2.1 time: 0.020304 Jul 19 15:34:48.345565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 248/494] 10.222.0.42 () {58 vars in 1217 bytes} [Tue Jul 19 15:34:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170539260 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:34:48.699791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:48.700488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:48.706888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:48.707327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:48.708087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:48.708507 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:48.998940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:49.007091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:49.008634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:49.009829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2b63b5df-0b74-407a-8c3f-ec5861e153bf tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1721 microversion: 2.20 time: 0.313933 Jul 19 15:34:49.010382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 247/495] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:48 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:49.447240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dff98dd2-de32-4602-bdcf-56d1c80544f7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: .version_select at 0x7f8322c95b80>, body: {"keypair": {"name": "tempest-keypair-52123659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPapxglh3ei9vGLDMpfQsRcgrHqedeUhHAgwt8FPJA+6k5c79VLvFYuqCz6dvnfjyl1YAoB028uYCpnGm4vydRSRsGM/bE7GfSmfQ6IvVH57B6ijNSkBz/iqFZX4dC0puA=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:49.463035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-dff98dd2-de32-4602-bdcf-56d1c80544f7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for project 7d55d02d809143f682698fbb494f65f4. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:49.467406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-dff98dd2-de32-4602-bdcf-56d1c80544f7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for user 51eb5efc37ca4942831bc4d046f54da6 and project 7d55d02d809143f682698fbb494f65f4. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:49.491952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dff98dd2-de32-4602-bdcf-56d1c80544f7 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.049607 Jul 19 15:34:49.492559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 249/496] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:34:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:50.032280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:50.032907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:50.041303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:50.042065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:50.043008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:50.043969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:50.061318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-a9e80f5a-76e5-4cc3-a1e3-8696987e4ff6 req-75421578-e5bf-446b-bec7-1e00a9dfe6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6130f510-2f0f-4e30-9256-e9e1e590d9a7", "name": "network-vif-deleted", "tag": "322c9e2e-f213-49fe-b74e-1f93a7185e2c"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:50.088626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a9e80f5a-76e5-4cc3-a1e3-8696987e4ff6 req-75421578-e5bf-446b-bec7-1e00a9dfe6a9 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:50.089467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a9e80f5a-76e5-4cc3-a1e3-8696987e4ff6 req-75421578-e5bf-446b-bec7-1e00a9dfe6a9 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:50.104415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-a9e80f5a-76e5-4cc3-a1e3-8696987e4ff6 req-75421578-e5bf-446b-bec7-1e00a9dfe6a9 service nova] Creating event network-vif-deleted:322c9e2e-f213-49fe-b74e-1f93a7185e2c for instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 on hv-cinder-84984 Jul 19 15:34:50.114026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-a9e80f5a-76e5-4cc3-a1e3-8696987e4ff6 req-75421578-e5bf-446b-bec7-1e00a9dfe6a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057720 Jul 19 15:34:50.115343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 250/497] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:34:50.138167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:50.150641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:50.152798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:50.155412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aff5a6dd-aa37-4615-a7f6-93aad788199c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 200 len: 1654 microversion: 2.20 time: 0.130666 Jul 19 15:34:50.156249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 248/498] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:50 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 1654 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:50.937076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1999359705", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49542e1b-6d90-46b8-a047-af4acb0cf796"}], "security_groups": [{"name": "tempest-securitygroup--1367062879"}], "key_name": "tempest-keypair-52123659", "user_data": "}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:51.059398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] validate_networks() for [('49542e1b-6d90-46b8-a047-af4acb0cf796', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:34:51.175242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:51.176549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:51.183913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:51.184654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:51.186077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:51.186749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:51.200912 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 HTTP/1.1 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:34:51.207231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:34:51.209904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '6130f510-2f0f-4e30-9256-e9e1e590d9a7'} Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:34:51.211562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:34:51.213867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:34:51.217591 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:34:51.218962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-00f26e32-1031-4e9c-ba3a-b7f8bd248392 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 404 len: 111 microversion: 2.20 time: 0.047723 Jul 19 15:34:51.219979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 249/499] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:51 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 15:34:51.228583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fd0d807d-86ed-4e52-935b-38cc9f37fd7d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '.version_select at 0x7f83237319d0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:51.252009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fd0d807d-86ed-4e52-935b-38cc9f37fd7d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155074373" status: 204 len: 0 microversion: 2.20 time: 0.027025 Jul 19 15:34:51.252586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 250/500] 10.222.0.42 () {60 vars in 1258 bytes} [Tue Jul 19 15:34:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155074373 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 15:34:51.500244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:34:51.500820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:34:51.501423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:34:51.501837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:34:51.502248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:34:51.511585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:51.512438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:51.512846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:51.513428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:51.534237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for project 7d55d02d809143f682698fbb494f65f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:51.538536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Getting quotas for user 51eb5efc37ca4942831bc4d046f54da6 and project 7d55d02d809143f682698fbb494f65f4. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:51.550803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:34:51.553203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:34:51.602592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-07ecbe20-a40a-416a-a0bf-96c2c0f61fba tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671111 Jul 19 15:34:51.607133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 251/501] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:34:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:34:51.613460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fe94cd9b-bab0-47b4-9875-e0ff3da5de12 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:51.614527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fe94cd9b-bab0-47b4-9875-e0ff3da5de12 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:51.669520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fe94cd9b-bab0-47b4-9875-e0ff3da5de12 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:51.677547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fe94cd9b-bab0-47b4-9875-e0ff3da5de12 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1236 microversion: 2.1 time: 0.068207 Jul 19 15:34:51.678111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 251/502] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:51 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:51.934858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-85022fee-98ef-47fb-9478-a43149aca74b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: .version_select at 0x7f8322dacf70>, body: {"keypair": {"name": "tempest-keypair-2024998885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoB5OqKSPRFIjx4h0HibreSaQzNKvGMwU+r7JdWkBmsgUCpYB2eMOLDvBWhsheq6Eb5z8K5sOjFAWuh5R76QF6VbvI7jVXXGwICSNv9dKvmDKFq5YsvAIf9pvDmLhdv4Q=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:51.952910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-85022fee-98ef-47fb-9478-a43149aca74b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for project 9bf94c44535545689ddc74bc82888a46. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:51.957889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-85022fee-98ef-47fb-9478-a43149aca74b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for user ddb5e1dec1904ae183e131ba95ed1ef2 and project 9bf94c44535545689ddc74bc82888a46. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:51.980814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-85022fee-98ef-47fb-9478-a43149aca74b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050818 Jul 19 15:34:51.981460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 252/503] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Jul 19 15:34:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 15:34:52.695556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:52.696164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:52.703224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:52.703675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:52.704446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:52.705062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:52.806071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:52.813462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ecfba391-172a-46c0-bb0b-c8a9cacd2818 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1294 microversion: 2.1 time: 0.122155 Jul 19 15:34:52.814029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 252/504] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:52 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:53.769538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1879139875", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b997d6e-f833-4b48-a8a4-81e5d09aad0b"}], "security_groups": [{"name": "tempest-securitygroup--1060536603"}], "key_name": "tempest-keypair-2024998885", "user_data": "}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:53.830243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:53.830991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:53.837324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:53.837776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:53.838549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:53.838984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:54.007970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.network.neutron [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] validate_networks() for [('6b997d6e-f833-4b48-a8a4-81e5d09aad0b', None, None, None, None, None)] {{(pid=118006) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:34:54.217509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:54.225408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8b935588-b353-4957-8cb4-a3f3c0956fa4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.399397 Jul 19 15:34:54.226162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 253/505] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:53 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:54.736097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Flavor limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:34:54.736522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Image limits 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:34:54.737261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Flavor pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:34:54.737858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Image pref 0:0:0 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:34:54.738267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.virt.hardware [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118006) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:34:54.747145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:54.747640 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:54.748495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:54.748807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:54.775480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for project 9bf94c44535545689ddc74bc82888a46. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:34:54.781283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Getting quotas for user ddb5e1dec1904ae183e131ba95ed1ef2 and project 9bf94c44535545689ddc74bc82888a46. Resources: {'cores', 'ram', 'instances'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:34:54.792322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Going to run 1 instances... {{(pid=118006) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:34:54.794627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118006) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:34:54.848409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6a4919c6-34e9-416a-b505-14863e8ef1e1 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.078023 Jul 19 15:34:54.848409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 253/506] 10.222.0.42 () {62 vars in 1187 bytes} [Tue Jul 19 15:34:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 15:34:54.855533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:54.856383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:54.883788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-0ac0bb6e-16d6-43d8-89d0-347b307dba13 req-01432223-c2ce-4ab5-b514-93eecc8b4c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5692bc3-4f1b-41a7-af81-35af53099096", "tag": "1165febf-442e-40c1-8195-da217a05022f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:54.898434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0ac0bb6e-16d6-43d8-89d0-347b307dba13 req-01432223-c2ce-4ab5-b514-93eecc8b4c43 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:54.899166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-0ac0bb6e-16d6-43d8-89d0-347b307dba13 req-01432223-c2ce-4ab5-b514-93eecc8b4c43 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:54.915111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-0ac0bb6e-16d6-43d8-89d0-347b307dba13 req-01432223-c2ce-4ab5-b514-93eecc8b4c43 service nova] Creating event network-changed:1165febf-442e-40c1-8195-da217a05022f for instance d5692bc3-4f1b-41a7-af81-35af53099096 on hv-cinder-84984 Jul 19 15:34:54.920935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-0ac0bb6e-16d6-43d8-89d0-347b307dba13 req-01432223-c2ce-4ab5-b514-93eecc8b4c43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043581 Jul 19 15:34:54.922370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 254/507] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:54.954791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:54.971166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:54.973308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:54.974568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d47a2578-680c-484e-a733-d428d64c2682 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1282 microversion: 2.20 time: 0.123383 Jul 19 15:34:54.975556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 254/508] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:54 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:55.248383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:55.254176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:55.262203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:55.262723 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:55.264721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:55.265181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:55.269510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:55.655302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:55.662740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0e69aba6-f811-4976-a2ef-af952263b91c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.419349 Jul 19 15:34:55.663309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 255/509] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:55 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:55.996328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:55.996928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:56.003134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:56.003579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:56.004339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:56.004774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:56.066316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:56.074348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:56.075976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:56.077077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a79e1977-7d4a-4485-a488-d968f0b059fb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1342 microversion: 2.20 time: 0.084689 Jul 19 15:34:56.077668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 255/510] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:55 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:56.679138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:56.679690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:56.687414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:56.687867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:56.688902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:56.689367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:57.026612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:57.034136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1404cbf5-7755-4e27-942b-0c05264cccf4 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.358904 Jul 19 15:34:57.034802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 256/511] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:56 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:57.095164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:57.095745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:57.101963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:57.102404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:57.103167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:57.103597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:57.211708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:57.219867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:57.221423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:57.222515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ef11aa5a-67c0-4649-a0fd-d615a79069de tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1340 microversion: 2.20 time: 0.131886 Jul 19 15:34:57.223100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 256/512] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:57 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1340 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:34:58.052320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:58.052942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:58.059181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:58.059408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:58.061330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:58.061948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:58.254272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:58.255011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:58.261499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:58.261947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:58.262869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:58.263496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:58.267705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:58.270007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:58.280365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6b9b83b4-f792-4f1d-8984-29ecdf454f5b tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.231925 Jul 19 15:34:58.281258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 257/513] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:58 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:34:58.500666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:58.514642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:58.516734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:58.518404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f9b776b0-0913-4d76-8fa2-07dbff0afb76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.280905 Jul 19 15:34:58.519613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 257/514] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:58 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:34:58.735240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-5bcaf8ea-a85e-4b9a-b0dd-4377661efd35 req-50ec4d4e-1f5f-4ad8-a3be-608c7d76d64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:34:58.747844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5bcaf8ea-a85e-4b9a-b0dd-4377661efd35 req-50ec4d4e-1f5f-4ad8-a3be-608c7d76d64f service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:58.748671 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5bcaf8ea-a85e-4b9a-b0dd-4377661efd35 req-50ec4d4e-1f5f-4ad8-a3be-608c7d76d64f service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:58.760545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-5bcaf8ea-a85e-4b9a-b0dd-4377661efd35 req-50ec4d4e-1f5f-4ad8-a3be-608c7d76d64f service nova] Creating event network-changed:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:34:58.766404 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-5bcaf8ea-a85e-4b9a-b0dd-4377661efd35 req-50ec4d4e-1f5f-4ad8-a3be-608c7d76d64f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035830 Jul 19 15:34:58.767307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 258/515] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:34:59.298301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:59.298895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:59.304894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:59.305372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:59.306124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:59.306552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:59.432043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:59.439444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c753c47d-cdcd-47ca-af98-7842d348015e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.145019 Jul 19 15:34:59.440003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 258/516] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:34:59 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:34:59.538604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:34:59.539247 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:34:59.541180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:59.546757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:59.547199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:59.547958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:34:59.548391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:34:59.681815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:59.690292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:59.691807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:34:59.692909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b528c2c7-7a1a-44cb-a6f1-3a9ca5b11131 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.159118 Jul 19 15:34:59.693505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 259/517] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:34:59 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:00.456184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:00.456787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:00.462946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:00.463395 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:00.464198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:00.464631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:00.524906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-3348e143-0daa-4f06-bb27-abd286c192dc req-1864a013-7f51-4f54-bf41-419d4afd2925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5692bc3-4f1b-41a7-af81-35af53099096", "name": "network-vif-plugged", "status": "completed", "tag": "1165febf-442e-40c1-8195-da217a05022f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:00.534472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-3348e143-0daa-4f06-bb27-abd286c192dc req-1864a013-7f51-4f54-bf41-419d4afd2925 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:00.534991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-3348e143-0daa-4f06-bb27-abd286c192dc req-1864a013-7f51-4f54-bf41-419d4afd2925 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:00.547967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-3348e143-0daa-4f06-bb27-abd286c192dc req-1864a013-7f51-4f54-bf41-419d4afd2925 service nova] Creating event network-vif-plugged:1165febf-442e-40c1-8195-da217a05022f for instance d5692bc3-4f1b-41a7-af81-35af53099096 on hv-cinder-84984 Jul 19 15:35:00.552989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-3348e143-0daa-4f06-bb27-abd286c192dc req-1864a013-7f51-4f54-bf41-419d4afd2925 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032139 Jul 19 15:35:00.553690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 260/518] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:00.644514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:00.652330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-765dbc9b-de32-4b99-8c8a-16cb6c651ce2 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.199997 Jul 19 15:35:00.653246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 259/519] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:00 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:00.711924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:00.712734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:00.719612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:00.720140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:00.720977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:00.721506 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:00.874949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:00.882977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:00.884494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:00.885628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6416a14b-4dc0-4fc7-a55f-c37adb6f50d7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.178018 Jul 19 15:35:00.886183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 261/520] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:00 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:01.669392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:01.670070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:01.675990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:01.676426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:01.677284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:01.677717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:01.805198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:01.812753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ccffa366-31ac-4cf6-97c0-5184a45aa958 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1362 microversion: 2.1 time: 0.147246 Jul 19 15:35:01.813383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 260/521] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:01 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:01.904052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:01.904758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:01.911494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:01.911941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:01.912748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:01.913524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:02.047674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:02.055529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:02.057035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:02.058289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4f11044a-a69e-4103-99f2-cd0d380a32d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.158208 Jul 19 15:35:02.058865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 262/522] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:01 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:35:02.830022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:02.830561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:02.836783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:02.837262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:02.838043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:02.838482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:02.969011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:02.976488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d2d8a8e5-120c-420d-b82e-0838f4a52d63 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1548 microversion: 2.1 time: 0.151050 Jul 19 15:35:02.977043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 261/523] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:02 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:02.992843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:02.993350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:02.999739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.000185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.000944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.001401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.076772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:03.077408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:03.077954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d1c5b6eb-8e26-4635-9414-a1ee1b951cee tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088848 Jul 19 15:35:03.078548 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 263/524] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:35:02 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:03.083747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.084218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.084982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.085462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.577905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:03.585742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:03.587276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:03.588373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-383c5a02-9f2f-4050-b16b-c2d9b4fd2420 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.516400 Jul 19 15:35:03.588926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 262/525] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:03 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:35:03.636238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53fd9b62-df0f-4ad6-915c-8c6900cecca8"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:03.637341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:03.644008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.644459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.645257 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:03.645694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:03.893338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ac67f683-e1f3-467b-8133-d2c143eaf7ec tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260910 Jul 19 15:35:03.893972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 264/526] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:35:03 2022] POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:04.326784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-e6d686dc-b408-4668-8058-8f548c961265 req-db1d8a13-faeb-42cc-86b3-194fad04bb91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5692bc3-4f1b-41a7-af81-35af53099096", "tag": "1165febf-442e-40c1-8195-da217a05022f"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:04.334888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e6d686dc-b408-4668-8058-8f548c961265 req-db1d8a13-faeb-42cc-86b3-194fad04bb91 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:04.335322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e6d686dc-b408-4668-8058-8f548c961265 req-db1d8a13-faeb-42cc-86b3-194fad04bb91 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:04.348497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-e6d686dc-b408-4668-8058-8f548c961265 req-db1d8a13-faeb-42cc-86b3-194fad04bb91 service nova] Creating event network-changed:1165febf-442e-40c1-8195-da217a05022f for instance d5692bc3-4f1b-41a7-af81-35af53099096 on hv-cinder-84984 Jul 19 15:35:04.353516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-e6d686dc-b408-4668-8058-8f548c961265 req-db1d8a13-faeb-42cc-86b3-194fad04bb91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030511 Jul 19 15:35:04.354149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 263/527] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:04.608563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:04.609397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:04.618064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:04.618669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:04.619516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:04.620076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:04.764351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=4 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:04.787891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=20 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:04.839812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:04.847262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-1e756d6a-8680-43c6-b706-8a7ceee53b13 req-c34d1f4e-76b6-40b3-ac38-0482544f4509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "name": "network-vif-plugged", "status": "completed", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:04.863881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-1e756d6a-8680-43c6-b706-8a7ceee53b13 req-c34d1f4e-76b6-40b3-ac38-0482544f4509 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:04.864607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-1e756d6a-8680-43c6-b706-8a7ceee53b13 req-c34d1f4e-76b6-40b3-ac38-0482544f4509 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:04.868973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:04.870800 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:04.872465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-852d34d5-cc51-4537-8842-9dcf0b035742 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.268817 Jul 19 15:35:04.886626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 265/528] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:04 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:04.892764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-1e756d6a-8680-43c6-b706-8a7ceee53b13 req-c34d1f4e-76b6-40b3-ac38-0482544f4509 service nova] Creating event network-vif-plugged:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:35:04.897759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-1e756d6a-8680-43c6-b706-8a7ceee53b13 req-c34d1f4e-76b6-40b3-ac38-0482544f4509 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054458 Jul 19 15:35:04.898345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 264/529] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:05.893716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:05.894253 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:05.900861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:05.901353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:05.902106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:05.902532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:06.036863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:06.045071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:06.046636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:06.047729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-37869b58-6652-444f-80f2-d74d4753d279 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1408 microversion: 2.20 time: 0.157979 Jul 19 15:35:06.048277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 266/530] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:05 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:07.066901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:07.067594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:07.069521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:07.075025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:07.075695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:07.076460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:07.076886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:07.206250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:07.214066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:07.216092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:07.217405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-52c9f4d8-f746-42b5-92a9-4f164ec181f8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1599 microversion: 2.20 time: 0.154839 Jul 19 15:35:07.217959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 265/531] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:07 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:35:07.235077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:07.235573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:07.242091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:07.242532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:07.243295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:07.243721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:07.319906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-72f7fb9b-44e2-4834-86b2-3f05ec4ab1c7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089283 Jul 19 15:35:07.320500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 267/532] 10.222.0.42 () {60 vars in 1315 bytes} [Tue Jul 19 15:35:07 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:35:08.232382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-295bf959-c21e-4da5-9104-7b9ef1248048 req-9e48191b-3fed-4fe3-a881-a6822cc55c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:08.240212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-295bf959-c21e-4da5-9104-7b9ef1248048 req-9e48191b-3fed-4fe3-a881-a6822cc55c76 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:08.240641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-295bf959-c21e-4da5-9104-7b9ef1248048 req-9e48191b-3fed-4fe3-a881-a6822cc55c76 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:08.252332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-295bf959-c21e-4da5-9104-7b9ef1248048 req-9e48191b-3fed-4fe3-a881-a6822cc55c76 service nova] Creating event network-changed:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:35:08.258382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-295bf959-c21e-4da5-9104-7b9ef1248048 req-9e48191b-3fed-4fe3-a881-a6822cc55c76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030043 Jul 19 15:35:08.258977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 266/533] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:11.431773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:11.432770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:11.439153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:11.439595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:11.440357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:11.440792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:11.463536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lazy-loading 'flavor' on Instance uuid d881b649-c3ba-48da-99cc-7f7093436495 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:35:11.619541 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-76afe48d-d247-4071-bad4-1d24e4c267c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/action" status: 200 len: 32 microversion: 2.1 time: 0.192101 Jul 19 15:35:11.620154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 268/534] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:35:11 2022] POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:35:11.630900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:11.631582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:11.638624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:11.639064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:11.639883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:11.640249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:11.852675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:11.861901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b8f8ec59-251e-40bd-94e1-e61b34683b1e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.235897 Jul 19 15:35:11.862471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:11 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:12.880523 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:12.881235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:12.887475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:12.888214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:12.888983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:12.889457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:13.018244 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:13.026420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5f9fe0a3-cce9-467c-ba40-6d9dc94f3be7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.150783 Jul 19 15:35:13.026979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 269/536] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:12 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:14.043575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:14.044824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:14.046860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:14.052116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:14.052558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:14.053340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:14.053767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:14.297154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:14.305064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-778d2a0b-00be-4200-b1be-e95f88aac75e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.265389 Jul 19 15:35:14.305655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 268/537] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:14 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:15.322716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:15.323305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:15.330660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:15.331103 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:15.331859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:15.332289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:15.347537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:15.479337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:15.487249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fb089208-aa30-4e25-b3bc-71b1d98fe376 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.168413 Jul 19 15:35:15.487811 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 270/538] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:15 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:16.504166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:16.504708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:16.510763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:16.511207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:16.511961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:16.513128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:16.640585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:16.648933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2a28c26f-e3cc-4866-8b1b-2d077035f1d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.148651 Jul 19 15:35:16.649526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 269/539] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:16 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:16.820583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:16.821111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:16.828061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:16.828516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:16.829323 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:16.829761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:16.852796 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cbfd867e-bc74-418e-8b3a-d9db723318fc tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036173 Jul 19 15:35:16.853397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 271/540] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:35:16 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:17.666754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:17.667387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:17.674171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:17.674555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:17.675305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:17.675729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:17.807378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:17.815891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-435a748e-a7f2-4cd9-9bb3-2a47b77deafb tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.152937 Jul 19 15:35:17.816459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 270/541] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:17 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:18.164391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a1d2f59-5065-4215-9009-77433e201d92"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:18.165535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:18.172419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:18.172862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:18.173642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:18.174070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:18.654681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5cf7448f-9fa5-42ba-94eb-e1eb3ef13f16 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.494184 Jul 19 15:35:18.655337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 272/542] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:35:18 2022] POST /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:18.833468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:18.834011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:18.840155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:18.840604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:18.841531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:18.842025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:18.970248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:18.978164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-64d3619d-658d-4d38-8f31-89b7202562ff tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.148856 Jul 19 15:35:18.978732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 271/543] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:18 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:19.995908 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:19.996587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:20.002839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:20.003286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:20.004039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:20.004468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:20.134528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:20.142539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d36d6cd2-e300-475a-9fd8-4bd9b0266b0f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.151308 Jul 19 15:35:20.143090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 273/544] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:19 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:21.159854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:21.160459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:21.167055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:21.167529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:21.168305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:21.169250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:21.303910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:21.312872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-06fe523e-1f22-442f-a4af-4b2e9c6b223a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.157076 Jul 19 15:35:21.313471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 272/545] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:21 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:22.330724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:22.331328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:22.337943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:22.338394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:22.339174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:22.339608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:22.515452 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:22.523721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0906cd74-5e12-4fc7-8e5a-3ec3f8ccd6c8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.197439 Jul 19 15:35:22.524287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 274/546] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:22 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:23.541400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:23.541956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:23.548399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:23.548835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:23.549623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:23.550049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:23.676279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:23.684079 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-03352aa2-db3e-40c3-839e-e21f152db7d2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.146783 Jul 19 15:35:23.684638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 273/547] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:23 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:24.700969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:24.701713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:24.708618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:24.709068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:24.709862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:24.710294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:24.842478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:24.850398 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1614acff-1c8d-4bd5-9726-bd9102db97a8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.153407 Jul 19 15:35:24.850955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 275/548] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:24 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:25.867817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:25.868416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:25.876956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:25.877496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:25.878286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:25.878720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.006326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:26.015753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b7cca91e-e774-47d3-87cc-29054ca13183 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.151792 Jul 19 15:35:26.016311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 274/549] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:25 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:26.131111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a1d2f59-5065-4215-9009-77433e201d92"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:26.132113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:26.139583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.140037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.140798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.141263 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.219515 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: POST /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments HTTP/1.1 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 74 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:35:26.221508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {"volumeAttachment": {"volumeId": "5a1d2f59-5065-4215-9009-77433e201d92"}} Jul 19 15:35:26.222942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'server_id': '3a25fda1-2381-4002-9308-d8ee3a03382c', 'body': {'volumeAttachment': {'volumeId': '5a1d2f59-5065-4215-9009-77433e201d92'}}} Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:26.223687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:26.224849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 400 to user: Invalid volume: volume 5a1d2f59-5065-4215-9009-77433e201d92 is already attached to instances: 3a25fda1-2381-4002-9308-d8ee3a03382c {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8aae7274-009a-42c1-8116-5ccb344c8b51 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095940 Jul 19 15:35:26.226175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 276/550] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:35:26 2022] POST /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:35:26.285437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:26.285927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:26.291819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.292260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.293018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.293483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.368986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:26.374009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lazy-loading 'services' on Instance uuid 3a25fda1-2381-4002-9308-d8ee3a03382c {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:35:26.443590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0aa33171-e13d-4fb5-b443-89a3a152cd24 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments/5a1d2f59-5065-4215-9009-77433e201d92" status: 202 len: 0 microversion: 2.1 time: 0.162007 Jul 19 15:35:26.444167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 275/551] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:35:26 2022] DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments/5a1d2f59-5065-4215-9009-77433e201d92 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:35:26.452561 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:26.453747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:26.460690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.461131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.461906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:26.462332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:26.491695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e6a50690-c93b-47f4-93d1-396369c4846a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042999 Jul 19 15:35:26.492192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 277/552] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:35:26 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:27.034729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:27.035448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:27.042621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.043070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.044077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.044512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.173738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:27.181570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4ab5d228-b15a-4874-b967-715b6094c3ae tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.152317 Jul 19 15:35:27.182144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 276/553] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:27 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:27.503829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:27.504750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:27.511194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.511641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.512404 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.512837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.541014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-65901a50-97a8-4920-8b3e-9596bfce29b8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041130 Jul 19 15:35:27.541594 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 278/554] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:35:27 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:35:27.598344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:27.598889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:27.604751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.605230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.605990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.606414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.630594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:35:27.703918 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f3c1ec3d-84ae-4b24-956a-b8e78c04b9f7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 204 len: 0 microversion: 2.1 time: 0.109046 Jul 19 15:35:27.704410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 277/555] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:35:27 2022] DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:35:27.712338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:27.712940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:27.718994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.719444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.720207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:27.720647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:27.856058 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:27.864262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bd65e836-26dd-45b5-9041-090f3101b1f0 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1679 microversion: 2.1 time: 0.155581 Jul 19 15:35:27.864822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 279/556] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:27 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:28.199739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:28.200425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:28.206516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:28.206964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:28.207727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:28.208157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:28.337248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:28.345921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4eb17e2b-faed-47ae-8a25-a49371c19396 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.150313 Jul 19 15:35:28.346478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 278/557] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:28 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:28.882178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:28.882782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:28.889877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:28.890318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:28.891073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:28.891507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:29.022296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:29.029832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fa9dc5a8-f237-483d-b23b-0cea63c5901b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1679 microversion: 2.1 time: 0.151543 Jul 19 15:35:29.030394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 280/558] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:28 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:29.362576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:29.363168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:29.369214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:29.369656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:29.370404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:29.370830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:29.504055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:29.511921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2edab743-9e8a-4eb4-8577-4d2e4a2cd1cd tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.153146 Jul 19 15:35:29.512418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 279/559] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:29 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:30.047652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:30.048191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:30.050666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=44 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:30.055897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:30.056369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:30.057132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:30.057585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:30.217291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:30.225467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2f41883e-fc9d-4dc8-aaaf-7139d7a887d7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1679 microversion: 2.1 time: 0.182336 Jul 19 15:35:30.226450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 281/560] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:30 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:30.530274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:30.530823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:30.536902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:30.537381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:30.538218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:30.538674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:30.751567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:30.759603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93b892aa-2cca-403f-aeda-8f9473df6b33 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.233804 Jul 19 15:35:30.760105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 280/561] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:30 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:31.245413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:31.246090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:31.254184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:31.255428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:31.255880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:31.256385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:31.332168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:31.339539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-edcc96b4-b94a-42e4-8329-47781772154d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 200 len: 1612 microversion: 2.1 time: 0.099615 Jul 19 15:35:31.340099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 282/562] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:31 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 1612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:31.438918 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-7c117d0b-7d24-4a78-8b60-c05625f8ca27 req-5656f6b9-14f6-4b1b-bbf6-7023d896cf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a25fda1-2381-4002-9308-d8ee3a03382c", "name": "network-vif-deleted", "tag": "acfedf94-bc10-4604-ab68-83a78472ec10"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:31.446767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-7c117d0b-7d24-4a78-8b60-c05625f8ca27 req-5656f6b9-14f6-4b1b-bbf6-7023d896cf91 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:31.447204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-7c117d0b-7d24-4a78-8b60-c05625f8ca27 req-5656f6b9-14f6-4b1b-bbf6-7023d896cf91 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:31.461620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-7c117d0b-7d24-4a78-8b60-c05625f8ca27 req-5656f6b9-14f6-4b1b-bbf6-7023d896cf91 service nova] Creating event network-vif-deleted:acfedf94-bc10-4604-ab68-83a78472ec10 for instance 3a25fda1-2381-4002-9308-d8ee3a03382c on hv-cinder-84984 Jul 19 15:35:31.468113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-7c117d0b-7d24-4a78-8b60-c05625f8ca27 req-5656f6b9-14f6-4b1b-bbf6-7023d896cf91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Jul 19 15:35:31.469198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 281/563] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:31.776511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:31.777124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:31.783897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:31.784355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:31.785159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:31.785606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:31.962579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:31.970739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b4ca642e-cbac-4985-8290-375fec386f02 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1737 microversion: 2.1 time: 0.198053 Jul 19 15:35:31.971313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 283/564] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:31 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:32.357959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:32.359010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:32.366734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:32.367173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:32.367980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:32.368406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:32.384565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c HTTP/1.1 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:35:32.387448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:35:32.389184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '3a25fda1-2381-4002-9308-d8ee3a03382c'} Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:35:32.390784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:35:32.392590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:35:32.393967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:35:32.393967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-91f6d13a-a030-4046-8223-7cb0f584c120 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 404 len: 111 microversion: 2.1 time: 0.037728 Jul 19 15:35:32.393967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 282/565] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:32 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:35:32.399517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5af9cb8e-cb9c-461f-a83d-dcd13da212ab tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '.version_select at 0x7f8322cfae50>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:32.421430 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5af9cb8e-cb9c-461f-a83d-dcd13da212ab tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-42653525" status: 202 len: 0 microversion: 2.1 time: 0.025963 Jul 19 15:35:32.422022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 284/566] 10.222.0.42 () {58 vars in 1214 bytes} [Tue Jul 19 15:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-42653525 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:35:32.987908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:32.988859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:32.995680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:32.996147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:32.997312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:32.997839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.016366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-444845ec-a5b6-405d-b2c6-e0fad89cb98c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: .version_select at 0x7f8322cbaa60>, body: {"keypair": {"name": "tempest-keypair-1719103271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbzxCS2VzK3KNvMzkl6CRfhVue+2N0xE9o+5ltJpjMn7LlYse1q/uUZ7xWnjBMH3BCp/8IgpOTEWKET/1wyR3Gmjo9OZnPNADpk7sfP5L94QnPH9dOykpwXXCni3VmL8w=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:33.032034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-444845ec-a5b6-405d-b2c6-e0fad89cb98c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:35:33.035942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-444845ec-a5b6-405d-b2c6-e0fad89cb98c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:35:33.057844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-444845ec-a5b6-405d-b2c6-e0fad89cb98c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045820 Jul 19 15:35:33.058451 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 285/567] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:35:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:33.143979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:33.152191 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f1c3656c-2bc4-45a1-8a4d-a4605ece6726 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1717 microversion: 2.1 time: 0.168104 Jul 19 15:35:33.152756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 283/568] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:32 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:33.206872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:33.207622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:33.213830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.214285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.215066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.215504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.301444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] HTTP exception thrown: Cannot 'detach_volume' instance d881b649-c3ba-48da-99cc-7f7093436495 while it is in vm_state rescued Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Request method failure captured: Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments/53fd9b62-df0f-4ad6-915c-8c6900cecca8 HTTP/1.1 Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s5kjxTTWPkWpRKUKuTVlNF2k3dmirpjAJi92koCKFEFtpTmL0ovShxKBmUo6VasvyYl8dVOooHRSV7gpqVoVmmJP8pyg_Yzx00EkXiBNho-xdeVLSHUNzNZWwfnM1eRGjRqb1K7enOhS68iU4Y8ltqi36KF995_zWnV0gGrfnkiswo Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:35:33.303169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c3bc3582aa7420a9a1fcccacff362bd"}]}] Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 491d052f3d2947cea318b0753fffd1fa Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:35:33.304704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Cannot 'detach_volume' instance d881b649-c3ba-48da-99cc-7f7093436495 while it is in vm_state rescued Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'server_id': 'd881b649-c3ba-48da-99cc-7f7093436495', 'id': '53fd9b62-df0f-4ad6-915c-8c6900cecca8'} Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d881b649-c3ba-48da-99cc-7f7093436495 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:35:33.305717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d881b649-c3ba-48da-99cc-7f7093436495 while it is in vm_state rescued Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d881b649-c3ba-48da-99cc-7f7093436495 while it is in vm_state rescued Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:35:33.307213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Returning 409 to user: Cannot 'detach_volume' instance d881b649-c3ba-48da-99cc-7f7093436495 while it is in vm_state rescued {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:35:33.309287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c774505f-8c73-4eea-8110-e6850efa4256 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments/53fd9b62-df0f-4ad6-915c-8c6900cecca8" status: 409 len: 152 microversion: 2.1 time: 0.101921 Jul 19 15:35:33.309287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 286/569] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:35:33 2022] DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments/53fd9b62-df0f-4ad6-915c-8c6900cecca8 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 15:35:33.314465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:33.315348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:33.320987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.321530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.322295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.322731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.392985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-654a3b93-3c11-4d85-aa49-0a6b6536a797 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/action" status: 202 len: 0 microversion: 2.1 time: 0.082751 Jul 19 15:35:33.394001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 284/570] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:35:33 2022] POST /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:35:33.403710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:33.405199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:33.414514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.415025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.416078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:33.416735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:33.929700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:33.939140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c3758757-3ba0-4e8a-8727-b7a12f1ce74e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1725 microversion: 2.1 time: 0.540117 Jul 19 15:35:33.939934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 287/571] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:33 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1725 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:34.789665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701480018", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc814b7d-034a-42a8-85dc-8ab08a546a8c"}], "security_groups": [{"name": "tempest-securitygroup--624320198"}], "key_name": "tempest-keypair-1719103271", "user_data": "}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:34.890052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] validate_networks() for [('fc814b7d-034a-42a8-85dc-8ab08a546a8c', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:35:34.957065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:34.957990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:34.964298 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:34.964748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:34.965547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:34.966288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:34.970287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:35.155798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:35.163759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d094b970-251f-4edf-8e14-159d17d88870 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1725 microversion: 2.1 time: 0.210608 Jul 19 15:35:35.164322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 288/572] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:34 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:35:35.377949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:35:35.378366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:35:35.378864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:35:35.379263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:35:35.379666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:35:35.388655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:35.389081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:35.389902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:35.390335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:35.406824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:35:35.410759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Getting quotas for user 5507329a6bb84cfbbdac99b85f346ab8 and project af417e926a2d4d328a37fbb7baedbe78. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:35:35.422261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:35:35.424568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:35:35.471378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c931259d-a6d2-4cab-bef7-8f05a30bae1f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.686309 Jul 19 15:35:35.472076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 285/573] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:35:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:35:35.482864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d519bd47-369c-4010-b7f8-c54b302862ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:35.483475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d519bd47-369c-4010-b7f8-c54b302862ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:35.538346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d519bd47-369c-4010-b7f8-c54b302862ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:35.545774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d519bd47-369c-4010-b7f8-c54b302862ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1241 microversion: 2.1 time: 0.067528 Jul 19 15:35:35.546329 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 289/574] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:35 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:36.181163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:36.181690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:36.188207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:36.188666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:36.189465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:36.189906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:36.321002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:36.332009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-46841dd1-33b3-4254-b55e-c9cd273f91bf tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1725 microversion: 2.1 time: 0.154891 Jul 19 15:35:36.332579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 286/575] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:36 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:36.562850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:36.564886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:36.571540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:36.572107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:36.572981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:36.573563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:36.641015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:36.648893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-18eb4e7d-1b35-443e-b2ec-8b277128d6ec tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1237 microversion: 2.1 time: 0.090716 Jul 19 15:35:36.649487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 290/576] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:36 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1237 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:37.349222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:37.349991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:37.356047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.356610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.358033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.358540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.580365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:37.589031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0e8a0772-1802-44a6-a413-920c291b60b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1731 microversion: 2.1 time: 0.243687 Jul 19 15:35:37.589622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 287/577] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:37 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:37.605935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:37.606504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:37.612883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.613434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.614199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.614630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.665527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:37.666309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:37.672887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.673441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.674278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:37.674712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:37.759567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:37.767579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20726495-1254-4d7a-90f5-057205e109a7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1299 microversion: 2.1 time: 0.105994 Jul 19 15:35:37.768147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 288/578] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:37 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:35:37.774867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-393ade38-9cf6-4b3b-b0a3-6a336c86bac4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172883 Jul 19 15:35:37.779899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 291/579] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:35:37 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:38.667436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-97dd2a0d-dc32-47e2-9b0b-b1e293d84fff req-09921f29-25e7-4af4-8cab-69f047d9b7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d75e24-cea7-4466-b728-5999cb2e2924", "tag": "878a7fa3-8ed0-45e7-8682-0abc54bd15f2"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:38.698465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-97dd2a0d-dc32-47e2-9b0b-b1e293d84fff req-09921f29-25e7-4af4-8cab-69f047d9b7f6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:38.699565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-97dd2a0d-dc32-47e2-9b0b-b1e293d84fff req-09921f29-25e7-4af4-8cab-69f047d9b7f6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:38.715363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-97dd2a0d-dc32-47e2-9b0b-b1e293d84fff req-09921f29-25e7-4af4-8cab-69f047d9b7f6 service nova] Creating event network-changed:878a7fa3-8ed0-45e7-8682-0abc54bd15f2 for instance 14d75e24-cea7-4466-b728-5999cb2e2924 on hv-cinder-84984 Jul 19 15:35:38.721245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-97dd2a0d-dc32-47e2-9b0b-b1e293d84fff req-09921f29-25e7-4af4-8cab-69f047d9b7f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064443 Jul 19 15:35:38.722126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 289/580] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:38.786518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:38.787387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:38.795030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:38.795773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:38.796845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:38.797722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:38.945157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-bca14424-5cdf-424b-b3f7-46531f4fb282 req-2723f746-848d-484f-a677-0d32afd8e0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:38.954581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-bca14424-5cdf-424b-b3f7-46531f4fb282 req-2723f746-848d-484f-a677-0d32afd8e0b9 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:38.955278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-bca14424-5cdf-424b-b3f7-46531f4fb282 req-2723f746-848d-484f-a677-0d32afd8e0b9 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:38.967315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-bca14424-5cdf-424b-b3f7-46531f4fb282 req-2723f746-848d-484f-a677-0d32afd8e0b9 service nova] Creating event network-changed:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:35:38.972823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-bca14424-5cdf-424b-b3f7-46531f4fb282 req-2723f746-848d-484f-a677-0d32afd8e0b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031528 Jul 19 15:35:38.973990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 290/581] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:39.089793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:39.098213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c9516ad1-c750-496b-a32b-506ef3fd2c73 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.316106 Jul 19 15:35:39.098865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 292/582] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:38 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:40.116449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:40.117084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:40.123736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:40.124170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:40.124922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:40.125389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:40.255057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:40.262357 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-41167885-9e0c-415a-ab9a-27ca7251b51a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.150226 Jul 19 15:35:40.263593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 291/583] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:40 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:40.641710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:40.642193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:40.648388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:40.648825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:40.649637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:40.650335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:40.675459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f06a7aa4-463d-4931-aceb-aedb8046a211 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/ips" status: 200 len: 145 microversion: 2.1 time: 0.100197 Jul 19 15:35:40.676010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 293/584] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:35:40 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/ips => generated 145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:40.989936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-b414cc33-1565-43bc-a3e1-c8cccea8d587 req-99c43ad7-50b6-47b0-aa2d-50a8247c725a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:40.998890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-b414cc33-1565-43bc-a3e1-c8cccea8d587 req-99c43ad7-50b6-47b0-aa2d-50a8247c725a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:40.999332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-b414cc33-1565-43bc-a3e1-c8cccea8d587 req-99c43ad7-50b6-47b0-aa2d-50a8247c725a service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:41.010748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-b414cc33-1565-43bc-a3e1-c8cccea8d587 req-99c43ad7-50b6-47b0-aa2d-50a8247c725a service nova] Creating event network-changed:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:35:41.016948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-b414cc33-1565-43bc-a3e1-c8cccea8d587 req-99c43ad7-50b6-47b0-aa2d-50a8247c725a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030573 Jul 19 15:35:41.017997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 292/585] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:41.280967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:41.281870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:41.287824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:41.288460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:41.289265 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:41.289845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:41.475060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:41.482491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-96cc2e9f-75e8-45de-a6c7-529ab1ad2fb7 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.206415 Jul 19 15:35:41.483048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 294/586] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:41 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:42.005328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa93d7ca-8538-4485-9167-f02aa5a77a34"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:42.006501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:42.012641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:42.013094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:42.013883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:42.014316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:42.017929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:42.264629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0c949ef0-ab86-408c-9609-344df7d05837 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263482 Jul 19 15:35:42.265579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 293/587] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:35:41 2022] POST /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:42.499732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:42.500272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:42.506728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:42.507170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:42.507924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:42.508351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:42.638671 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:42.647437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ad002d87-a76e-4a1c-b8a6-21ca9f885fc9 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.151567 Jul 19 15:35:42.648106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 295/588] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:42 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:43.666322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:43.666943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:43.673728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:43.674167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:43.674917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:43.675342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:43.808874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:43.817171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-62621b6b-aa16-427a-b793-8274d39fb832 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.155729 Jul 19 15:35:43.817738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 294/589] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:43 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:44.372064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:44.372563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:44.378642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:44.379089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:44.379855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:44.380308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:44.404676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-06f5451b-084a-4ec1-90ae-230e89be0fe9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/ips" status: 200 len: 151 microversion: 2.20 time: 0.086626 Jul 19 15:35:44.404676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 296/590] 10.222.0.42 () {60 vars in 1288 bytes} [Tue Jul 19 15:35:44 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/ips => generated 151 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:35:44.766775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-111b39d2-cb9f-4ea2-923f-b1894737f2c7 req-a7705ed5-289c-4777-b7bc-b6551a8d7a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d75e24-cea7-4466-b728-5999cb2e2924", "name": "network-vif-plugged", "status": "completed", "tag": "878a7fa3-8ed0-45e7-8682-0abc54bd15f2"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:44.771143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:44.776906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-111b39d2-cb9f-4ea2-923f-b1894737f2c7 req-a7705ed5-289c-4777-b7bc-b6551a8d7a80 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:44.777984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-111b39d2-cb9f-4ea2-923f-b1894737f2c7 req-a7705ed5-289c-4777-b7bc-b6551a8d7a80 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:44.791099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-111b39d2-cb9f-4ea2-923f-b1894737f2c7 req-a7705ed5-289c-4777-b7bc-b6551a8d7a80 service nova] Creating event network-vif-plugged:878a7fa3-8ed0-45e7-8682-0abc54bd15f2 for instance 14d75e24-cea7-4466-b728-5999cb2e2924 on hv-cinder-84984 Jul 19 15:35:44.796008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-111b39d2-cb9f-4ea2-923f-b1894737f2c7 req-a7705ed5-289c-4777-b7bc-b6551a8d7a80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034180 Jul 19 15:35:44.796662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 295/591] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:44.834061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:44.834659 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:44.840786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:44.841386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:44.842156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:44.842585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:44.987068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:44.994683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-53cdcc2f-479f-45a6-91cb-9ff7544c9bb5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.164418 Jul 19 15:35:44.995330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 297/592] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:44 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:46.010048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:46.010696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:46.015161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:46.015839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:46.023410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:46.023848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:46.024601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:46.025031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:46.155549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:46.162937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-54f4cac9-6b49-46b2-b522-6f5a912bad9b tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1366 microversion: 2.1 time: 0.154869 Jul 19 15:35:46.163502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 296/593] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:46 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:47.045006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:47.045588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:47.047812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:47.053311 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.053752 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.054536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.054964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.077023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lazy-loading 'flavor' on Instance uuid eea9811c-e5c8-42c7-9ad8-f24db9070534 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:35:47.180741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:47.181442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:47.188694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.189152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.190044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.190483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.323879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:47.332233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5baf5048-c07d-4a13-a967-bcb42e8f195f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/action" status: 202 len: 0 microversion: 2.20 time: 0.291487 Jul 19 15:35:47.333078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 298/594] 10.222.0.42 () {62 vars in 1318 bytes} [Tue Jul 19 15:35:47 2022] POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:35:47.333641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ec3b7736-8145-4576-99bc-755985f41a08 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1556 microversion: 2.1 time: 0.157237 Jul 19 15:35:47.334202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 297/595] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:35:47 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:35:47.345286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:47.347099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:47.350857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:47.351340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:47.354439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.355145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.355937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.356930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.357774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.358222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.359043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:47.359463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:47.471635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-31d81efd-df9d-4ca6-b66d-0eb561c669f3 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124537 Jul 19 15:35:47.472227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 298/596] 10.222.0.42 () {58 vars in 1274 bytes} [Tue Jul 19 15:35:47 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:47.530634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:47.538818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:47.540700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:47.541829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dd183118-8f9e-42ec-b263-fc6b9654bfcd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.201312 Jul 19 15:35:47.542453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 299/597] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:47 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:48.423719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-b2c2ad95-b38f-40de-982a-a43b2d72dc42 req-d1570702-52d3-45cd-a959-9f7de58dee56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d75e24-cea7-4466-b728-5999cb2e2924", "tag": "878a7fa3-8ed0-45e7-8682-0abc54bd15f2"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:48.431943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-b2c2ad95-b38f-40de-982a-a43b2d72dc42 req-d1570702-52d3-45cd-a959-9f7de58dee56 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:48.432460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-b2c2ad95-b38f-40de-982a-a43b2d72dc42 req-d1570702-52d3-45cd-a959-9f7de58dee56 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:48.444101 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-b2c2ad95-b38f-40de-982a-a43b2d72dc42 req-d1570702-52d3-45cd-a959-9f7de58dee56 service nova] Creating event network-changed:878a7fa3-8ed0-45e7-8682-0abc54bd15f2 for instance 14d75e24-cea7-4466-b728-5999cb2e2924 on hv-cinder-84984 Jul 19 15:35:48.449234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-b2c2ad95-b38f-40de-982a-a43b2d72dc42 req-d1570702-52d3-45cd-a959-9f7de58dee56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030802 Jul 19 15:35:48.449868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 299/598] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:48.560007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:48.561189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:48.567421 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:48.568453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:48.569266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:48.569704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:48.804369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:48.813386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:48.815201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:48.816446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-516c94be-ebc2-4131-b613-c23f02939202 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.260526 Jul 19 15:35:48.817193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 300/599] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:48 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:49.773126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:49.774150 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:49.781762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.782213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.782980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.783418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.813476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-baea998b-c69a-4af1-bb19-465c9ac824cf tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Jul 19 15:35:49.814056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 300/600] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:35:49 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:49.823882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:49.824431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:49.834535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.834988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.835398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:49.835799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.835993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:49.836240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.842354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.842792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.843548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:49.843975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:49.865846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7e964dbd-ffb7-4c1c-a37a-b8ec9d5ee83c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34" status: 200 len: 194 microversion: 2.1 time: 0.045913 Jul 19 15:35:49.866601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 301/601] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Jul 19 15:35:49 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:49.980592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:49.989517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:49.991225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:49.992517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea3c414f-2fcf-43eb-8fb5-c7e0ae387f11 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.160791 Jul 19 15:35:49.993440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 301/602] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:49 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:35:51.011735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:51.012403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:51.019315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:51.020029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:51.020813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:51.021286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:51.156728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:51.164806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:51.166355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:51.167524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cba3af2d-98d6-4f11-acee-ea61ce96572e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.159786 Jul 19 15:35:51.168093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 302/603] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:51 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:51.190688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e77c3247-53e6-4aee-bdef-872094c002ba"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:35:51.191955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:51.198573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:51.199019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:51.199803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:51.200300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:51.462056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-76bcb418-6768-4267-9d26-e139bcd9c742 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "POST /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275395 Jul 19 15:35:51.462680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 302/604] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:35:51 2022] POST /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:35:52.186584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:52.187185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:52.193781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:52.194226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:52.194989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:52.195426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:52.328174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:52.336021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:52.337546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:52.338687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f42b1744-3b64-4120-8f28-e5e5b289511a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.156116 Jul 19 15:35:52.339235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 303/605] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:52 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:53.358430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:53.359113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:53.365917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:53.366368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:53.367134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:53.367576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:53.499426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:53.507360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:53.508790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:53.509986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a30d2c01-2ab5-4fa3-99c3-20362d19ede0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.155903 Jul 19 15:35:53.510542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 303/606] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:53 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:54.529696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:54.530242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:54.536696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:54.537183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:54.537940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:54.538369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:54.667256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:54.670173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:54.677051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:54.678594 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:54.679733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7b52b112-4d82-4338-84b2-41a20ffe2a59 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.154662 Jul 19 15:35:54.680272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 304/607] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:54 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:55.697714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:55.698312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:55.705341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:55.705784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:55.706539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:55.706969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:55.845890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:55.853698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:55.855203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:55.856438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-577acdfd-020d-48e6-bb96-3d6d801322e7 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.162495 Jul 19 15:35:55.856989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 304/608] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:55 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:56.874839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:56.875437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:56.882909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:56.883355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:56.884138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:56.884570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:57.012760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:57.020816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:57.022352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:57.023491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1dc681f6-e8fe-4103-b112-0288e4d5c4b0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.153025 Jul 19 15:35:57.024042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 305/609] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:56 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:58.041915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:58.042444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:58.049307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:58.049789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:58.050555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:58.050988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:58.182959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:58.191404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:58.192927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:58.194089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2b97d6ec-bb3a-41ee-9f36-fc0c284dc2e5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.156148 Jul 19 15:35:58.194632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 305/610] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:58 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:35:58.944653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:58.945660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:58.953124 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:58.953599 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:58.954365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:58.954797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:58.983289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a89ee173-eaa3-4a23-9fa5-e08e2d1d50f9 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042493 Jul 19 15:35:58.983835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 306/611] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:35:58 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:59.138214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:59.138779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:59.145428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.145869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.146621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.147046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.175363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7167ce29-0274-4732-badd-95a73acf39ce tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34" status: 200 len: 194 microversion: 2.1 time: 0.041829 Jul 19 15:35:59.176053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 306/612] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Jul 19 15:35:59 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:35:59.186555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:59.187044 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:59.193322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.193764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.194529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.194961 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.212382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:35:59.212988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:35:59.219250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.219699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.220470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:35:59.220909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:35:59.277786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lazy-loading 'services' on Instance uuid d5692bc3-4f1b-41a7-af81-35af53099096 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:35:59.351775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-80213f86-da63-4191-a80f-0f6a41217e13 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34" status: 202 len: 0 microversion: 2.1 time: 0.169496 Jul 19 15:35:59.356113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 307/613] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:35:59 2022] DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/aa93d7ca-8538-4485-9167-f02aa5a77a34 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:35:59.356445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:59.365493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:59.367213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:35:59.368502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6385c9df-e121-4379-a320-80e2b89b8278 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.159988 Jul 19 15:35:59.369266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 307/614] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:35:59 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:00.389161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:00.389840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:00.391736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:00.397473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:00.397964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:00.398719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:00.399148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:00.542667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:00.551831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:00.553367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:00.555325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ac50a8ee-3e79-40ee-8aa6-615d1f2bcd35 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.171689 Jul 19 15:36:00.555899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 308/615] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:00 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:01.520220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:01.520820 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:01.528504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.528955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.529755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.530193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.555573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:01.560547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bb21f15d-9160-4fbf-9684-d22fe9ffefc5 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/e77c3247-53e6-4aee-bdef-872094c002ba" status: 200 len: 194 microversion: 2.1 time: 0.044750 Jul 19 15:36:01.561166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 308/616] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Jul 19 15:36:01 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/e77c3247-53e6-4aee-bdef-872094c002ba => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:01.570945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:01.571463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:01.575232 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:01.575960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:01.578892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.579422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.580432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.581082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.582089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.582538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.583313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:01.583753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:01.667972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lazy-loading 'services' on Instance uuid d5692bc3-4f1b-41a7-af81-35af53099096 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:36:01.735136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:01.744613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:01.746315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:01.747606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3e37cc5e-2497-4e7f-a5ac-437e0c1e8373 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.177349 Jul 19 15:36:01.748242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 309/617] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:01 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:01.748970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7d292f44-4b77-47a5-9755-cafcb59ab73c tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/e77c3247-53e6-4aee-bdef-872094c002ba" status: 202 len: 0 microversion: 2.1 time: 0.181802 Jul 19 15:36:01.752463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 309/618] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:36:01 2022] DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments/e77c3247-53e6-4aee-bdef-872094c002ba => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:36:02.767678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:02.768273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:02.774527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:02.774999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:02.775755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:02.776188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:02.905633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:02.913634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:02.914387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:02.915133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:02.915436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:02.916272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-060c32a2-8ee8-4794-81b0-0625d5cbd5bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.152940 Jul 19 15:36:02.916820 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 310/619] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:02 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:02.921959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:02.922400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:02.923162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:02.923592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:02.952048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4b96a81f-a35d-4d86-a095-46dd1f5ac900 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042297 Jul 19 15:36:02.952586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 310/620] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:02 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:36:03.056378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:03.057394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:03.064244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.064909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.065856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.066289 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.093968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d28ec84a-68d0-4fe4-8b74-0996c97b0314 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041421 Jul 19 15:36:03.094506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 311/621] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:03 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:36:03.150441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:03.150932 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:03.157147 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.157608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.158369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.158804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.183256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:36:03.258010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8d2b931a-2f73-447b-875a-a5465c1aac3e tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 204 len: 0 microversion: 2.1 time: 0.110853 Jul 19 15:36:03.258636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 311/622] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:03 2022] DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:03.267480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:03.268074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:03.274235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.274676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.275453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.275878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.409294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:03.416631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-697b5eeb-3d90-4683-9fdc-d8b497d82256 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1672 microversion: 2.1 time: 0.153112 Jul 19 15:36:03.417220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 312/623] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:03 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:03.934981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:03.935663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:03.942330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.942756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:03.943513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:03.943942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:04.072944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:04.081578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:04.083085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:04.084266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9ed23e8a-b2b4-402b-ad4c-ba13c999e0a2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.153699 Jul 19 15:36:04.084827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 312/624] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:03 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:04.435602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:04.436207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:04.442936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:04.443380 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:04.444143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:04.444574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:04.573613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:04.581674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f8787fa6-309e-4fbb-9e29-3354557dde9a tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1672 microversion: 2.1 time: 0.150598 Jul 19 15:36:04.582233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 313/625] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:04 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:05.103480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:05.104076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:05.110855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:05.111293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:05.112053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:05.112485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:05.269343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:05.277400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:05.278987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:05.280150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4ea4c64b-1643-46bc-9a16-c9b5ae463607 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.180528 Jul 19 15:36:05.280723 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 313/626] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:05 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:05.599772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:05.600431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:05.607859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:05.608311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:05.609086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:05.609549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:05.795275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb5efc37ca4942831bc4d046f54da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55d02d809143f682698fbb494f65f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:05.803009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f538b5d8-609e-4eb8-b5af-03260ac02467 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 200 len: 1672 microversion: 2.1 time: 0.207186 Jul 19 15:36:05.803781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 314/627] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:05 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:06.216893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-e79f1134-bb0e-4d4f-b82b-b15ea94a76cd req-84d88422-9d4c-442e-9381-e3c425a5da42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5692bc3-4f1b-41a7-af81-35af53099096", "name": "network-vif-deleted", "tag": "1165febf-442e-40c1-8195-da217a05022f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:06.225590 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e79f1134-bb0e-4d4f-b82b-b15ea94a76cd req-84d88422-9d4c-442e-9381-e3c425a5da42 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:06.226511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e79f1134-bb0e-4d4f-b82b-b15ea94a76cd req-84d88422-9d4c-442e-9381-e3c425a5da42 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:06.251367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-e79f1134-bb0e-4d4f-b82b-b15ea94a76cd req-84d88422-9d4c-442e-9381-e3c425a5da42 service nova] Creating event network-vif-deleted:1165febf-442e-40c1-8195-da217a05022f for instance d5692bc3-4f1b-41a7-af81-35af53099096 on hv-cinder-84984 Jul 19 15:36:06.262003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-e79f1134-bb0e-4d4f-b82b-b15ea94a76cd req-84d88422-9d4c-442e-9381-e3c425a5da42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114022 Jul 19 15:36:06.263743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 314/628] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:06.298558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:06.299162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:06.305868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:06.306312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:06.307130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:06.309716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:06.446850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:06.454865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:06.456389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:06.457552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8082281d-769b-44c7-a7b9-a0e01be3c431 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.162895 Jul 19 15:36:06.458106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 315/629] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:06 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:06.821069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:06.822064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:06.831877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:06.832755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:06.834268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:06.835078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:06.851277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 HTTP/1.1 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:06.852862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:06.854544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'd5692bc3-4f1b-41a7-af81-35af53099096'} Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:06.855507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:06.857283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:06.858675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:06.858675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ad14bb71-d3e7-4740-a66f-7070e7ae3e40 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 404 len: 111 microversion: 2.1 time: 0.037781 Jul 19 15:36:06.858675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 315/630] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:06 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:06.863397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f495362b-2cf3-4970-ac3d-4eb5e374caac tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '.version_select at 0x7f8323580dc0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:06.881372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f495362b-2cf3-4970-ac3d-4eb5e374caac tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52123659" status: 202 len: 0 microversion: 2.1 time: 0.021677 Jul 19 15:36:06.881945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 316/631] 10.222.0.42 () {58 vars in 1214 bytes} [Tue Jul 19 15:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52123659 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:07.475910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:07.476515 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:07.483859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:07.484420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:07.485219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:07.485652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:07.627328 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:07.636904 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:07.638575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:07.639729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-350a4858-cee8-4424-a62d-f8fb2c19b864 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.167835 Jul 19 15:36:07.640282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 316/632] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:07 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:08.658391 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:08.658947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:08.666515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:08.666958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:08.667797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:08.668215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:08.802478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:08.812056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:08.813585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:08.814765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dfa91314-bee7-48fc-bdc1-ffebb8e811b5 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1745 microversion: 2.20 time: 0.161269 Jul 19 15:36:08.815325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 317/633] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:08 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:09.784810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:09.785400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:09.791709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.792185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.793538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.794004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.806885 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 HTTP/1.1 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:09.809113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.810396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'd5692bc3-4f1b-41a7-af81-35af53099096'} Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:09.811105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.812489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.814073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:09.814073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1ed76cdc-61d5-4e8d-9983-8e6f950a75f3 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 404 len: 111 microversion: 2.1 time: 0.029536 Jul 19 15:36:09.814073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 317/634] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:09 2022] DELETE /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:09.818737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:09.819370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: d5692bc3-4f1b-41a7-af81-35af53099096] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:09.826396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.826837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.827593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.828051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.833953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:09.834553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:09.840586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.841034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.841822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:09.842257 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:09.843495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 HTTP/1.1 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:09.845130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.846523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'd5692bc3-4f1b-41a7-af81-35af53099096'} Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:09.847246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. Jul 19 15:36:09.848863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:09.850342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance d5692bc3-4f1b-41a7-af81-35af53099096 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:09.850342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8cab7db9-2713-4606-9140-429e4f8019a6 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096" status: 404 len: 111 microversion: 2.1 time: 0.031670 Jul 19 15:36:09.850342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 318/635] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:09 2022] GET /compute/v2.1/servers/d5692bc3-4f1b-41a7-af81-35af53099096 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:09.982716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:09.990645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:09.992145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:09.993351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fcbef887-2067-4e4d-9541-2a9056c241a3 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1745 microversion: 2.20 time: 0.163108 Jul 19 15:36:09.993900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 318/636] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:09 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:10.987827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:10.988415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:10.994809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:10.995254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:10.996724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:10.997189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:11.012263 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:11.012852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.012944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 HTTP/1.1 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:11.014160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.015434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'a6448684-07a9-4238-bcd7-8b1f4620d268'} Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:11.016178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.017482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.019931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:11.019931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-156e8c9b-dd41-4b5a-b61b-3de3aa440dad tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 404 len: 111 microversion: 2.1 time: 0.031578 Jul 19 15:36:11.019931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 319/637] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:10 2022] DELETE /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:11.025287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:11.025399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] [instance: a6448684-07a9-4238-bcd7-8b1f4620d268] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:11.027630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:11.028532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:11.029352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:11.029796 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:11.032255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:11.032645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:11.033432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:11.033867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:11.047611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] HTTP exception thrown: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Request method failure captured: Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 HTTP/1.1 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4ZCgjXb2DBPC26rfSagMJoCr6tOIhynglu79bbPbmhv_EXsnKzIGQN1ZBNxvwGXWB5-DUyYX5NSMA8XAKWMU4A-PsiQahigtPyhg4X32i0nxyn9pGqWNehW5SOUyDRDn9OHnRT9tIEVd3vyduFsaAIdQe2Wr9_R8jG-63X4pVzFm4 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:11.049196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d55d02d809143f682698fbb494f65f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d55d02d809143f682698fbb494f65f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d55d02d809143f682698fbb494f65f4"}]}] Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 7d55d02d809143f682698fbb494f65f4 Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1575048574 Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 51eb5efc37ca4942831bc4d046f54da6 Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeTestJSON-1575048574-project Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.050708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'a6448684-07a9-4238-bcd7-8b1f4620d268'} Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:11.051636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. Jul 19 15:36:11.053197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:11.054784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] Returning 404 to user: Instance a6448684-07a9-4238-bcd7-8b1f4620d268 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:11.054784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-037381e4-9b1a-42de-9c1e-d841af762466 tempest-AttachVolumeTestJSON-1575048574 tempest-AttachVolumeTestJSON-1575048574-project] 10.222.0.42 "GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268" status: 404 len: 111 microversion: 2.1 time: 0.029604 Jul 19 15:36:11.054784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 320/638] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:11 2022] GET /compute/v2.1/servers/a6448684-07a9-4238-bcd7-8b1f4620d268 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:11.179248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:11.188469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:11.189990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:11.191142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c62ef113-56a5-403d-904d-ae3f69f85065 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1745 microversion: 2.20 time: 0.183356 Jul 19 15:36:11.191692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 319/639] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:11 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:12.211715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:12.212430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:12.219328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:12.219941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:12.220782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:12.221362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:12.480887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:12.489491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:12.491282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:12.492639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d7bb2924-485e-4551-adf1-325991e3a21a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.286986 Jul 19 15:36:12.505300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 321/640] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:12 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:13.121637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-a996af46-fc6c-41db-a719-531ac373dd62 req-fe928e42-923d-4a6b-87be-cf17e837434f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "name": "network-vif-plugged", "status": "completed", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:13.130916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a996af46-fc6c-41db-a719-531ac373dd62 req-fe928e42-923d-4a6b-87be-cf17e837434f service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:13.131598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a996af46-fc6c-41db-a719-531ac373dd62 req-fe928e42-923d-4a6b-87be-cf17e837434f service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:13.145039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-a996af46-fc6c-41db-a719-531ac373dd62 req-fe928e42-923d-4a6b-87be-cf17e837434f service nova] Creating event network-vif-plugged:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:36:13.151853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-a996af46-fc6c-41db-a719-531ac373dd62 req-fe928e42-923d-4a6b-87be-cf17e837434f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151118 Jul 19 15:36:13.152751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 320/641] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:13.512360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:13.512908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:13.523719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:13.524160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:13.527986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:13.530154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:13.702706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:13.711995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:13.714316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:13.715695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2c833c20-a766-4441-919b-403af83dda24 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.208102 Jul 19 15:36:13.716740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 322/642] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:13 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:14.654922 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:14.656212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:14.663952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.664789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:14.665661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.671065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:14.677189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:14.726445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lazy-loading 'flavor' on Instance uuid ae776f5e-076c-42bb-bd62-8f3afdff9746 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:36:14.735028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:14.736181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:14.756807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.757287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:14.758081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.758511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:14.898065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5ef1700c-4f9e-41a0-b687-cc7242bada23 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "POST /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746/action" status: 202 len: 0 microversion: 2.1 time: 0.253157 Jul 19 15:36:14.900961 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 321/643] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:36:14 2022] POST /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:14.909992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:14.911098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:14.929977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.932438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:14.934030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:14.934652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:15.138902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:15.162794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:15.171454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:15.176640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-712ea90c-cb03-4e5b-b503-3633d2269345 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.443648 Jul 19 15:36:15.181487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 323/644] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:14 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:15.194533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:15.203588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dca93f6b-0a8f-4fd3-84c9-de30722ff9ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.298547 Jul 19 15:36:15.205072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 322/645] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:14 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:16.197337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:16.197939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:16.203318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:16.208183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.208645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.209656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.210232 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.222079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:16.223174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:16.239208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.239816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.240732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.241345 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.480995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:16.491026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4689ea8e-9f53-480d-95c5-715c37f84c78 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.273468 Jul 19 15:36:16.491622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 323/646] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:16 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:16.535603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:16.545307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:16.547797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:16.549182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6e6537df-4611-4926-bbc8-5729698eba93 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.355656 Jul 19 15:36:16.550627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 324/647] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:16 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:16.798228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-995a5587-7fff-4d76-a2a6-3325a82481c6 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Action: 'create', calling method: .version_select at 0x7f8322c52280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1569720621"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:16.851019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:16.851588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:16.858113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.858656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.859566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:16.860077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:16.960497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lazy-loading 'services' on Instance uuid d881b649-c3ba-48da-99cc-7f7093436495 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:36:17.064567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20482240-fc47-4a88-a6d3-b53435ffaf79 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments/53fd9b62-df0f-4ad6-915c-8c6900cecca8" status: 202 len: 0 microversion: 2.1 time: 0.217741 Jul 19 15:36:17.077888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 325/648] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:36:16 2022] DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments/53fd9b62-df0f-4ad6-915c-8c6900cecca8 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:36:17.095759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:17.096847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:17.109774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.110272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.111439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.112185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.156578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0f6c1002-0fbc-40e5-b625-130f1d1533e1 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073074 Jul 19 15:36:17.158374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 326/649] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:17 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:17.247495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-995a5587-7fff-4d76-a2a6-3325a82481c6 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.600440 Jul 19 15:36:17.255177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 324/650] 10.222.0.42 () {60 vars in 1154 bytes} [Tue Jul 19 15:36:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 603 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 15:36:17.260752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-75a97cba-8089-477a-a2b8-d33ca9617e2e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8323731430>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:17.317669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-75a97cba-8089-477a-a2b8-d33ca9617e2e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 200 len: 345 microversion: 2.1 time: 0.061175 Jul 19 15:36:17.318247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 327/651] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:17 2022] GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:17.508934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:17.509933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:17.518337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.518877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.519986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.520496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.567844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:17.568919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:17.578609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.581052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.590000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:17.591002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:17.754844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:17.763486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-739ee9b1-3b35-47af-a266-04f1f2a346f0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.258488 Jul 19 15:36:17.768496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 325/652] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:17 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:17.829410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:17.833060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:17.838353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:17.841764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:17.843173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f6c3172a-a555-4b7a-83b4-fbeb162b26d9 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.279269 Jul 19 15:36:17.844292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 328/653] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:17 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:18.170878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.171937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:18.179949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.180900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.183844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.184986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.226909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-74ecde2b-496a-49b3-ab35-debab75c9ce2 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062253 Jul 19 15:36:18.227834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 326/654] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:36:18.316951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.317895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:18.327073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.327764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.328694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.329452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.331205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-015b04cd-e746-4728-a7c6-70223c9098a5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322ce1550>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.360886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:36:18.426826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-015b04cd-e746-4728-a7c6-70223c9098a5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 200 len: 346 microversion: 2.1 time: 0.099825 Jul 19 15:36:18.427573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 327/655] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:18.441823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-db2ade64-311b-4a84-bd6d-6ddae8486095 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Action: 'create', calling method: .version_select at 0x7f8322cfae50>, body: {"snapshot": {"volume_id": "65ea0609-0e4c-496e-aaaf-424dba92b316", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-334858020"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:18.471683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-632ed83d-7e82-4613-9c7b-ad7fe38524b3 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 204 len: 0 microversion: 2.1 time: 0.158260 Jul 19 15:36:18.474530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 329/656] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:18 2022] DELETE /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:18.485366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.486529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:18.494428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.495698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.497210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.497779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.667588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:18.675882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-57714196-8e97-4517-9b32-16954c2457c4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1691 microversion: 2.1 time: 0.196739 Jul 19 15:36:18.676146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 330/657] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1691 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:18.686187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-db2ade64-311b-4a84-bd6d-6ddae8486095 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.249789 Jul 19 15:36:18.686944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 328/658] 10.222.0.42 () {60 vars in 1161 bytes} [Tue Jul 19 15:36:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:18.704804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6a9ffd09-1480-49e0-8dc0-077c1d24db15 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f83235708b0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.752900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6a9ffd09-1480-49e0-8dc0-077c1d24db15 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 286 microversion: 2.1 time: 0.055531 Jul 19 15:36:18.753838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 331/659] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:18.763771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c297b661-298e-4cd3-9447-c7782ac53a15 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bd5a60>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.786320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.787211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:18.795573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.796107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.797042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.797632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c297b661-298e-4cd3-9447-c7782ac53a15 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037800 Jul 19 15:36:18.797788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.798203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 329/660] 10.222.0.42 () {58 vars in 1139 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:18.809045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-638835a8-5588-4d26-922b-152bfe026f7c tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bd5670>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.842488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-638835a8-5588-4d26-922b-152bfe026f7c tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 286 microversion: 2.1 time: 0.037925 Jul 19 15:36:18.843439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 330/661] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:18.866005 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:18.867013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:18.874519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.875199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:18.876153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:18.876881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:19.061047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:19.072829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0c264b23-0c8a-460a-ba3a-fa6dbb21d722 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.290791 Jul 19 15:36:19.077189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 332/662] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:19.090004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:19.099226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:19.100929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:19.102702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0f5c5ec1-491c-49d7-8543-535bcaa6a4fd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.240825 Jul 19 15:36:19.103254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 331/663] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:18 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:19.694475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:19.695802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:19.703184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:19.704054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:19.705282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:19.705670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:19.857409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d8befc8e-c72e-4c0f-9e9b-7de6c96f4253 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bd50d0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:19.858710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:19.866279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-faa1cf10-8890-427f-8b75-b6d9dc8a830d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1691 microversion: 2.1 time: 0.176516 Jul 19 15:36:19.867058 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 333/664] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:19 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:19.899625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d8befc8e-c72e-4c0f-9e9b-7de6c96f4253 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 286 microversion: 2.1 time: 0.047706 Jul 19 15:36:19.900170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 332/665] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:19 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:20.091010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:20.091971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:20.098156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.098806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.099770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.100353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.129623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:20.130535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:20.138355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.138920 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.139918 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.140566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.322700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:20.333298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5d8576cd-37ac-46a6-b396-bb53690dfddd tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.246498 Jul 19 15:36:20.334425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 334/666] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:20 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:20.347207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:20.356440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:20.358312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:20.359575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9d37c8ff-9776-466a-b858-f9ee2db85a31 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.240009 Jul 19 15:36:20.362187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 333/667] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:20 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:20.882715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:20.883325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:20.891455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.891911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.893122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:20.894569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:20.912289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5e0326b3-f515-4af2-9959-28e24974c164 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bfc1f0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:20.952534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5e0326b3-f515-4af2-9959-28e24974c164 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 286 microversion: 2.1 time: 0.044461 Jul 19 15:36:20.953789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 334/668] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:20 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:36:21.059202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:21.069814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aa97228f-89fb-4241-86ce-6bd17d1d3bbe tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1691 microversion: 2.1 time: 0.190816 Jul 19 15:36:21.081451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 335/669] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:20 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:21.350608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:21.351195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:21.363461 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:21.364134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:21.364867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:21.365338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:21.378529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:21.379138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:21.394462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:21.394918 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:21.395701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:21.396154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:21.571296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:21.581589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f1fc1b07-fcd5-4df7-81e1-65cc921c08a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.235172 Jul 19 15:36:21.582525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 335/670] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:21 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:21.597959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:21.606914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:21.608417 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:21.609607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-52ae0ced-9737-4d8a-9be8-fbb5baadbdde tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.235011 Jul 19 15:36:21.610791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 336/671] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:21 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:21.965387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fa903bfa-3611-49e1-84c9-96761c7542ba tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bfc430>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:21.997746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fa903bfa-3611-49e1-84c9-96761c7542ba tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 287 microversion: 2.1 time: 0.036561 Jul 19 15:36:21.998448 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 336/672] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:21 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:22.008791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-509b21b8-2cfa-466f-8969-7d81d8b92caa tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8323731c10>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:22.070890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-509b21b8-2cfa-466f-8969-7d81d8b92caa tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 202 len: 0 microversion: 2.1 time: 0.066095 Jul 19 15:36:22.072799 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 337/673] 10.222.0.42 () {58 vars in 1253 bytes} [Tue Jul 19 15:36:22 2022] DELETE /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:22.080021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fbe8a6c4-afe0-4746-a6cb-c759d93593aa tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322d4bc10>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:22.095215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:22.095832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:22.103592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.104039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.106181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.106620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.113649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fbe8a6c4-afe0-4746-a6cb-c759d93593aa tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 200 len: 286 microversion: 2.1 time: 0.037481 Jul 19 15:36:22.114218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 337/674] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:22 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:22.247169 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:22.255411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d97ee2db-5ddd-412d-9d07-85f89e9e73f7 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1691 microversion: 2.1 time: 0.167481 Jul 19 15:36:22.255965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 338/675] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:22 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:22.599098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:22.599726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:22.606851 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.607300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.608065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.608504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.631074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:22.631681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:22.638283 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.638742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.639514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:22.639954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:22.804291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:22.811063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:22.812839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-04d12647-00b5-4e86-aada-649b8b6eda0f tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.217534 Jul 19 15:36:22.813518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 338/676] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:22 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:22.819158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:22.820666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:22.821853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea993edb-479e-47c1-b071-abef0da604ab tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1740 microversion: 2.20 time: 0.194726 Jul 19 15:36:22.822398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 339/677] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:22 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:23.125834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-64463a9a-8930-4f10-a4e5-a34fc8cd0ee5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bfcdc0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.154018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-64463a9a-8930-4f10-a4e5-a34fc8cd0ee5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] HTTP exception thrown: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-64463a9a-8930-4f10-a4e5-a34fc8cd0ee5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Request method failure captured: Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca HTTP/1.1 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s9wOoMtn92KatB93k8ft6APnyuBW8Tci2biEhWK_c8CapiyEfurpxjHGngja6w1ODcyA7bQfkmphJJGO4D2UO-aCYjhm5T6Ix8CNY4zkNTMeNm4ZIYXvcY8OczE452Kw4pMBssr6rN9UbsGzbclgDHYqoIJsVjJyRsy3hMEB-pJmks Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:23.156655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_921a4687972d45a5a5e91116265b9926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/921a4687972d45a5a5e91116265b9926"}]}] Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 9d8d48c0731d4aa5ad38a35e196053d2 Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca'} Jul 19 15:36:23.158159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. (HTTP 404) (Request-ID: req-48258123-2bc9-417e-8da3-d0954708e690) Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.159007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:23.160171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 15:36:23.161393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-64463a9a-8930-4f10-a4e5-a34fc8cd0ee5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Returning 404 to user: Snapshot dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:23.162597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-64463a9a-8930-4f10-a4e5-a34fc8cd0ee5 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca" status: 404 len: 111 microversion: 2.1 time: 0.036147 Jul 19 15:36:23.163439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 339/678] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Jul 19 15:36:23 2022] GET /compute/v2.1/os-snapshots/dcfdbb7c-3bac-4192-a6ea-9f1a0168b8ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:23.167729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ff1345d4-54f9-417a-a3a4-bcf085bd5c86 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f83235531f0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.236964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ff1345d4-54f9-417a-a3a4-bcf085bd5c86 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 202 len: 0 microversion: 2.1 time: 0.072990 Jul 19 15:36:23.237962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 340/679] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:36:23 2022] DELETE /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:23.257758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8e3f561c-9305-4000-95d6-94066ddeb3d7 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bd55e0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.275057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.276208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:23.284545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.286312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:23.287207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.288223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:23.317374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8e3f561c-9305-4000-95d6-94066ddeb3d7 tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 200 len: 345 microversion: 2.1 time: 0.072890 Jul 19 15:36:23.318141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 340/680] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:23 2022] GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:23.791481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:23.799355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-39b00fae-d5c8-4b52-83ad-0bde8a55812f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1691 microversion: 2.1 time: 0.531202 Jul 19 15:36:23.800012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 341/681] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:23 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1691 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:23.831746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.832522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:23.843033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:23.843721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:23.848736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.849216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:23.849999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.850438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:23.858993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.859450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:23.860229 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:23.860683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:24.278580 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:24.285491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:24.286358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fd002c37-12eb-4ee2-ba57-a8ff30beb614 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.460081 Jul 19 15:36:24.287109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 341/682] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:23 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:24.294694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:24.296356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:24.297660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05208598-87ae-4f2f-9738-720b4faecaf2 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1722 microversion: 2.20 time: 0.459118 Jul 19 15:36:24.298293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 342/683] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:23 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:24.330628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8a9d5fb-bade-418b-a067-eccd36a66b5e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322c99e50>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:24.360278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-f8a9d5fb-bade-418b-a067-eccd36a66b5e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] HTTP exception thrown: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8a9d5fb-bade-418b-a067-eccd36a66b5e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Request method failure captured: Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 HTTP/1.1 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s9wOoMtn92KatB93k8ft6APnyuBW8Tci2biEhWK_c8CapiyEfurpxjHGngja6w1ODcyA7bQfkmphJJGO4D2UO-aCYjhm5T6Ix8CNY4zkNTMeNm4ZIYXvcY8OczE452Kw4pMBssr6rN9UbsGzbclgDHYqoIJsVjJyRsy3hMEB-pJmks Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:24.362302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_921a4687972d45a5a5e91116265b9926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/921a4687972d45a5a5e91116265b9926"}]}] Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 9d8d48c0731d4aa5ad38a35e196053d2 Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '65ea0609-0e4c-496e-aaaf-424dba92b316'} Jul 19 15:36:24.363842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. (HTTP 404) (Request-ID: req-40b9d8ab-1b30-4011-b14d-8d8c3b885a9c) Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.364966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:24.366132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:36:24.367267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8a9d5fb-bade-418b-a067-eccd36a66b5e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Returning 404 to user: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f8a9d5fb-bade-418b-a067-eccd36a66b5e tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 404 len: 109 microversion: 2.1 time: 0.037358 Jul 19 15:36:24.368373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 342/684] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:24 2022] GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:24.375482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6c097697-508a-45ef-992a-aa3a40f52d4a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8323570280>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:24.403615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-6c097697-508a-45ef-992a-aa3a40f52d4a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] HTTP exception thrown: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6c097697-508a-45ef-992a-aa3a40f52d4a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Request method failure captured: Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 HTTP/1.1 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s9wOoMtn92KatB93k8ft6APnyuBW8Tci2biEhWK_c8CapiyEfurpxjHGngja6w1ODcyA7bQfkmphJJGO4D2UO-aCYjhm5T6Ix8CNY4zkNTMeNm4ZIYXvcY8OczE452Kw4pMBssr6rN9UbsGzbclgDHYqoIJsVjJyRsy3hMEB-pJmks Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:24.407922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_921a4687972d45a5a5e91116265b9926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/921a4687972d45a5a5e91116265b9926"}]}] Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 9d8d48c0731d4aa5ad38a35e196053d2 Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '65ea0609-0e4c-496e-aaaf-424dba92b316'} Jul 19 15:36:24.409502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. (HTTP 404) (Request-ID: req-c7ee6656-5ca0-4eb2-8a9c-2f0619aa050e) Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.410502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:36:24.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:36:24.413299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6c097697-508a-45ef-992a-aa3a40f52d4a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Returning 404 to user: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6c097697-508a-45ef-992a-aa3a40f52d4a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 404 len: 109 microversion: 2.1 time: 0.037614 Jul 19 15:36:24.414597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 343/685] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:36:24 2022] DELETE /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:24.433785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f2a76800-5014-4053-bd8a-98bd33b0a52a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Calling method '.version_select at 0x7f8322bca040>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:24.464894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-f2a76800-5014-4053-bd8a-98bd33b0a52a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] HTTP exception thrown: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f2a76800-5014-4053-bd8a-98bd33b0a52a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Request method failure captured: Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 HTTP/1.1 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s9wOoMtn92KatB93k8ft6APnyuBW8Tci2biEhWK_c8CapiyEfurpxjHGngja6w1ODcyA7bQfkmphJJGO4D2UO-aCYjhm5T6Ix8CNY4zkNTMeNm4ZIYXvcY8OczE452Kw4pMBssr6rN9UbsGzbclgDHYqoIJsVjJyRsy3hMEB-pJmks Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:24.466888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_921a4687972d45a5a5e91116265b9926"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/921a4687972d45a5a5e91116265b9926"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/921a4687972d45a5a5e91116265b9926"}]}] Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 921a4687972d45a5a5e91116265b9926 Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1519955041 Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 9d8d48c0731d4aa5ad38a35e196053d2 Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1519955041-project Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '65ea0609-0e4c-496e-aaaf-424dba92b316'} Jul 19 15:36:24.468413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. (HTTP 404) (Request-ID: req-fc43ba06-9f8d-41c5-bc09-5d7531bde62e) Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.472436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:36:24.473768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:36:24.475401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f2a76800-5014-4053-bd8a-98bd33b0a52a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] Returning 404 to user: Volume 65ea0609-0e4c-496e-aaaf-424dba92b316 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f2a76800-5014-4053-bd8a-98bd33b0a52a tempest-VolumesSnapshotsTestJSON-1519955041 tempest-VolumesSnapshotsTestJSON-1519955041-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316" status: 404 len: 109 microversion: 2.1 time: 0.047901 Jul 19 15:36:24.476649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 343/686] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:24 2022] GET /compute/v2.1/os-volumes/65ea0609-0e4c-496e-aaaf-424dba92b316 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:24.606434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-97fda594-c246-4d84-a72d-87735d48be53 req-b12fade9-1a45-4440-bb63-2c44254b1710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d881b649-c3ba-48da-99cc-7f7093436495", "name": "network-vif-deleted", "tag": "3a61078e-2c36-4a80-badc-bbc3093fe14d"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:24.618457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-97fda594-c246-4d84-a72d-87735d48be53 req-b12fade9-1a45-4440-bb63-2c44254b1710 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:24.624441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-97fda594-c246-4d84-a72d-87735d48be53 req-b12fade9-1a45-4440-bb63-2c44254b1710 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:24.641825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-97fda594-c246-4d84-a72d-87735d48be53 req-b12fade9-1a45-4440-bb63-2c44254b1710 service nova] Creating event network-vif-deleted:3a61078e-2c36-4a80-badc-bbc3093fe14d for instance d881b649-c3ba-48da-99cc-7f7093436495 on hv-cinder-84984 Jul 19 15:36:24.647797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-97fda594-c246-4d84-a72d-87735d48be53 req-b12fade9-1a45-4440-bb63-2c44254b1710 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046122 Jul 19 15:36:24.648683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 344/687] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:24.817397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:24.817920 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:24.824278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:24.824728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:24.825536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:24.825975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:24.895343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:24.903126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb83bed7-71a7-4232-9ad4-4e32d781fbda tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1623 microversion: 2.1 time: 0.089642 Jul 19 15:36:24.903843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 344/688] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:24 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1623 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:25.304686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:25.305458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:25.312336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.312799 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:25.313625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.314063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:25.316216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:25.317284 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:25.327421 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.328324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:25.330935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.331553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:25.540538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:25.549358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-068e078f-4a67-4a6e-a11e-ed504c9ed8ac tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.249233 Jul 19 15:36:25.550034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 345/689] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:25 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:25.570161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:25.578830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:25.580350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:25.581549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a7b2d7ec-e757-4b28-a74e-01e14054613c tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1722 microversion: 2.20 time: 0.269584 Jul 19 15:36:25.582103 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 345/690] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:25 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:25.920890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:25.921790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:25.928328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.928985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:25.929878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:25.930475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.001215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:26.009292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-26c4f097-c097-42f9-ba30-8fff99c5e098 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 200 len: 1331 microversion: 2.1 time: 0.093385 Jul 19 15:36:26.013222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 346/691] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:25 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:26.567134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:26.567735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:26.575157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.575598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.576399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.576828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.599855 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:26.600454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:26.607665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.608112 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.608880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.609343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.814538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:26.822427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2ff17233-99da-440b-bed3-a261411e852d tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.259120 Jul 19 15:36:26.823965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 346/692] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:26 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:26.858964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:26.866947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:26.868432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:26.870141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-96db4be5-400b-43fd-9415-e6ebd63e262a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1725 microversion: 2.20 time: 0.273751 Jul 19 15:36:26.870725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 347/693] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:26 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:26.889132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d502a9d3-d4c8-421e-8eef-b6b7796033f9"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:26.890262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:26.896644 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.897091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.897881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.898309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.997461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-4e8f2f51-d063-4b80-8bc5-ee0d65af41cb req-f5945503-da88-4048-a45d-7bd7a2101334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "name": "network-vif-unplugged", "status": "completed", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:27.006590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-4e8f2f51-d063-4b80-8bc5-ee0d65af41cb req-f5945503-da88-4048-a45d-7bd7a2101334 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.007064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-4e8f2f51-d063-4b80-8bc5-ee0d65af41cb req-f5945503-da88-4048-a45d-7bd7a2101334 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.020272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.compute.server_external_events [req-4e8f2f51-d063-4b80-8bc5-ee0d65af41cb req-f5945503-da88-4048-a45d-7bd7a2101334 service nova] Unable to find a host for instance eea9811c-e5c8-42c7-9ad8-f24db9070534. Dropping event network-vif-unplugged {{(pid=118007) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 15:36:27.021600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-4e8f2f51-d063-4b80-8bc5-ee0d65af41cb req-f5945503-da88-4048-a45d-7bd7a2101334 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028047 Jul 19 15:36:27.022608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 348/694] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 15:36:27.028706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.029508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: d881b649-c3ba-48da-99cc-7f7093436495] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:27.036084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.036949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.038808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.039409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.044123 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:27.056185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] HTTP exception thrown: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Request method failure captured: Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 HTTP/1.1 Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s5kjxTTWPkWpRKUKuTVlNF2k3dmirpjAJi92koCKFEFtpTmL0ovShxKBmUo6VasvyYl8dVOooHRSV7gpqVoVmmJP8pyg_Yzx00EkXiBNho-xdeVLSHUNzNZWwfnM1eRGjRqb1K7enOhS68iU4Y8ltqi36KF995_zWnV0gGrfnkiswo Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:27.058403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c3bc3582aa7420a9a1fcccacff362bd"}]}] Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 491d052f3d2947cea318b0753fffd1fa Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. Jul 19 15:36:27.059747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'd881b649-c3ba-48da-99cc-7f7093436495'} Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:27.060504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. Jul 19 15:36:27.061742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:27.064515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Returning 404 to user: Instance d881b649-c3ba-48da-99cc-7f7093436495 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:27.065668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-535f1758-8949-408a-9f82-b79fa423e937 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495" status: 404 len: 111 microversion: 2.1 time: 0.041749 Jul 19 15:36:27.066833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 349/695] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:27 2022] GET /compute/v2.1/servers/d881b649-c3ba-48da-99cc-7f7093436495 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:27.079267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fb922ac2-0676-4665-88f8-dac2d0b6e6d6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '.version_select at 0x7f83235a99d0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.097510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:27.111373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fb922ac2-0676-4665-88f8-dac2d0b6e6d6 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372700082" status: 202 len: 0 microversion: 2.1 time: 0.040258 Jul 19 15:36:27.112950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 350/696] 10.222.0.42 () {58 vars in 1220 bytes} [Tue Jul 19 15:36:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1372700082 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:27.210675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-293e1445-9d36-4457-ae06-f39b5568264f tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326873 Jul 19 15:36:27.217087 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 347/697] 10.222.0.42 () {62 vars in 1363 bytes} [Tue Jul 19 15:36:26 2022] POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:36:27.343263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.344156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:27.350460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.351036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.351923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.352444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.379889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0a1d3400-01c6-48d1-b4e7-93666637d6e0 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8322c523a0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.434628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0a1d3400-01c6-48d1-b4e7-93666637d6e0 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/44ffb18d-b296-46af-bb44-30fb2d1ff112" status: 200 len: 351 microversion: 2.1 time: 0.058264 Jul 19 15:36:27.435082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 348/698] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:27 2022] GET /compute/v2.1/os-volumes/44ffb18d-b296-46af-bb44-30fb2d1ff112 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:27.627308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e40347cd-93af-4d81-ad43-3e35c191c885 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments/d502a9d3-d4c8-421e-8eef-b6b7796033f9" status: 202 len: 0 microversion: 2.20 time: 0.288218 Jul 19 15:36:27.628827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 351/699] 10.222.0.42 () {60 vars in 1456 bytes} [Tue Jul 19 15:36:27 2022] DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments/d502a9d3-d4c8-421e-8eef-b6b7796033f9 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:27.701397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:27.702065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:27.711743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.712550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.713627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.714159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.801497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-94d4198b-9527-4cb1-a1ff-457081fb7953 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/action" status: 202 len: 0 microversion: 2.20 time: 0.105559 Jul 19 15:36:27.802588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 349/700] 10.222.0.42 () {62 vars in 1318 bytes} [Tue Jul 19 15:36:27 2022] POST /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:27.814019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.814626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:27.821677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.822340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.823944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.824392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.839912 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.844567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:27.851363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.851939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:27.853058 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:27.853605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:28.052208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:28.061980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:28.063444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:28.064596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-43cdef7d-6d36-48d3-975f-8fb9071ad9d8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1673 microversion: 2.20 time: 0.258016 Jul 19 15:36:28.065728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 352/701] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:27 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1673 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:28.067306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:28.076947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3add65fa-8f3a-444a-9e2e-2e3cfabddf08 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.240093 Jul 19 15:36:28.077862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 350/702] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:27 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:28.783086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-264fe2da-b936-42ab-ad06-f9679cef7a67 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f83235708b0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:28.835007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-264fe2da-b936-42ab-ad06-f9679cef7a67 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f78bb789-b4fb-464a-b0ce-36a5ef8c7ff7" status: 200 len: 350 microversion: 2.1 time: 0.056904 Jul 19 15:36:28.835566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 353/703] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:28 2022] GET /compute/v2.1/os-volumes/f78bb789-b4fb-464a-b0ce-36a5ef8c7ff7 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:29.094062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:29.094714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:29.094838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:29.095526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:29.102255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.102814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.104069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.104724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.116764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.117231 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.118010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.118439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.318255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:29.327006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7e07b101-3d05-4f23-a7bd-3f3b2c4b4776 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1568 microversion: 2.1 time: 0.236789 Jul 19 15:36:29.330442 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:29.332072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 354/704] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:29 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:29.338617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:29.340046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:29.341290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21ffa6eb-f6ab-4e3a-9cd1-e6581275cbed tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.260430 Jul 19 15:36:29.341832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 351/705] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:29 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:29.347673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:29.348360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:29.355580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.356036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.356808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.357430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.450090 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-82efe0f6-9b49-4734-a446-c13eb5b454b0 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "POST /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746/action" status: 202 len: 0 microversion: 2.1 time: 0.106250 Jul 19 15:36:29.450960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 355/706] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:36:29 2022] POST /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:29.459267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:29.459875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:29.466746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.467194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.467964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:29.468395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:29.740326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:29.748700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-64630433-9ab6-4bb0-854b-76e13eb03d20 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1576 microversion: 2.1 time: 0.293458 Jul 19 15:36:29.749652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 352/707] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:29 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1576 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:30.151332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.152332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:30.168593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.169382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.170242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.170909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.197666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:36:30.214390 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5cb84c9e-b0f3-4cf1-917b-daa9995c058a tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8322bfc8b0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.273876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5cb84c9e-b0f3-4cf1-917b-daa9995c058a tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9c3e01e0-692f-4056-84f8-4ebc99e6aa94" status: 200 len: 350 microversion: 2.1 time: 0.063483 Jul 19 15:36:30.274598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 353/708] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes/9c3e01e0-692f-4056-84f8-4ebc99e6aa94 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:36:30.285666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d2fa212f-8bbf-4d4e-982d-e331b1a0a4e3 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8322bd55e0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.298972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5c41273e-bf2e-459c-b5f8-ef60d85ca9fa tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 204 len: 0 microversion: 2.1 time: 0.155915 Jul 19 15:36:30.299544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 356/709] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:30 2022] DELETE /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:36:30.308327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.309005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:30.315243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.315649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.316408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.316854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.373267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d2fa212f-8bbf-4d4e-982d-e331b1a0a4e3 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091274 Jul 19 15:36:30.373794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 354/710] 10.222.0.42 () {58 vars in 1133 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:30.380718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.380718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:30.386439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.386439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.387420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.387905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.505031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:30.512851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-10c39c23-daae-4a38-8cab-2831100a2867 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1508 microversion: 2.1 time: 0.209121 Jul 19 15:36:30.513458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 357/711] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:30.522685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1a02bec0-fb51-4ccb-ae8c-c97edf2c50de tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f832348cee0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.552191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:30.560182 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:30.561697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:30.562839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fd1b7c63-0cc1-4c05-926e-3bed2fb7530d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.188137 Jul 19 15:36:30.563387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 355/712] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:30.602787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1a02bec0-fb51-4ccb-ae8c-c97edf2c50de tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084022 Jul 19 15:36:30.603359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 358/713] 10.222.0.42 () {58 vars in 1148 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:30.615413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6c4280c4-514f-4911-9390-c0572197bc3f tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8322bfcdc0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.696268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6c4280c4-514f-4911-9390-c0572197bc3f tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084520 Jul 19 15:36:30.696832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 356/714] 10.222.0.42 () {58 vars in 1133 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:30.710437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-45de5070-fc67-4d55-89e9-846792c086e6 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f83234f3160>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.765445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.766074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:30.767943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:30.773671 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.774113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.774874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:30.775300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:30.790710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-45de5070-fc67-4d55-89e9-846792c086e6 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085672 Jul 19 15:36:30.791277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 359/715] 10.222.0.42 () {58 vars in 1166 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:30.803120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-128e62c9-2b82-455b-bff3-ef437c707571 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8323564b80>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.883914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-128e62c9-2b82-455b-bff3-ef437c707571 tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084208 Jul 19 15:36:30.884398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 360/716] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:30.897321 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-89b50072-b592-4534-a514-8dd9d220600a tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f832348c790>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:30.923741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:30.931527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c8b95920-ef56-48e7-825a-9d088582e916 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1518 microversion: 2.1 time: 0.169810 Jul 19 15:36:30.932243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 357/717] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:30.979374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-89b50072-b592-4534-a514-8dd9d220600a tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085873 Jul 19 15:36:30.979958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 361/718] 10.222.0.42 () {58 vars in 1154 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:30.990996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0f2bd1b1-412b-47fc-b1fa-ed9b6d1005ff tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f8322bfcee0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.074140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0f2bd1b1-412b-47fc-b1fa-ed9b6d1005ff tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086834 Jul 19 15:36:31.074702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 358/719] 10.222.0.42 () {58 vars in 1187 bytes} [Tue Jul 19 15:36:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:31.086228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-88b82e20-1ec2-4b4f-b521-79dfa798bd3f tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] Calling method '.version_select at 0x7f832814bca0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.173809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-88b82e20-1ec2-4b4f-b521-79dfa798bd3f tempest-VolumesTestJSON-344241244 tempest-VolumesTestJSON-344241244-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091291 Jul 19 15:36:31.174366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 362/720] 10.222.0.42 () {58 vars in 1154 bytes} [Tue Jul 19 15:36:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:31.530310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.531005 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:31.537651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.538105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.538871 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.539307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.581191 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.581804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:31.588440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.588966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.589773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.590227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.720254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:31.727609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-796bad3a-c60a-473c-8de2-a912cd1aa278 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1508 microversion: 2.1 time: 0.202060 Jul 19 15:36:31.728175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 359/721] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:31 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:31.749659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:31.757492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:31.758994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:31.760149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-669774d5-01e9-4e90-8709-e7b01eda014b tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.183182 Jul 19 15:36:31.760697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 363/722] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:31 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:31.943074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.943593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:31.948724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:31.949363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:31.949994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.950438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.951200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.951626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.955478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.955925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.956689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:31.957121 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:31.975273 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-62211f93-0afe-4761-9aa5-702d6ec252f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/ips" status: 200 len: 149 microversion: 2.1 time: 0.036031 Jul 19 15:36:31.975868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 360/723] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:36:31 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:32.088514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:32.096082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-81b59bd8-998e-455e-aaa7-81e093da7f89 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1518 microversion: 2.1 time: 0.151041 Jul 19 15:36:32.096834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 364/724] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:31 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:32.746939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:32.747480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:32.762741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:32.763468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:32.764486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:32.765162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:32.779083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:32.780103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:32.792811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:32.796955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:32.797861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:32.798401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.093892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:33.105565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-708d7cf7-62d3-4d83-863f-ce28f9731f7e tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1508 microversion: 2.1 time: 0.362761 Jul 19 15:36:33.106455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 361/725] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:32 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:33.113318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:33.119801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:33.134337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:33.135603 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.136063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.136861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.137335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.150269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:33.152851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:33.157785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3520f9d2-2157-4de6-bff9-153b288963ef tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.383197 Jul 19 15:36:33.160560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 365/726] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:32 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:33.177021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-e03bf165-d985-4d76-ba82-19e7f28ecd76 req-160525e0-e5d2-4fcc-93c7-6126e699ec0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "name": "network-vif-unplugged", "status": "completed", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:33.190454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e03bf165-d985-4d76-ba82-19e7f28ecd76 req-160525e0-e5d2-4fcc-93c7-6126e699ec0c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.191246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-e03bf165-d985-4d76-ba82-19e7f28ecd76 req-160525e0-e5d2-4fcc-93c7-6126e699ec0c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.233054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-e03bf165-d985-4d76-ba82-19e7f28ecd76 req-160525e0-e5d2-4fcc-93c7-6126e699ec0c service nova] Creating event network-vif-unplugged:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:36:33.243775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-e03bf165-d985-4d76-ba82-19e7f28ecd76 req-160525e0-e5d2-4fcc-93c7-6126e699ec0c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070358 Jul 19 15:36:33.245236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 366/727] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:33.349358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87fe91f-3aca-41a8-b7d2-652e2327af8c"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:33.351343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:33.371561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.372172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.373078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.379202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.727834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:33.740673 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6a1adc3e-62fd-4f8b-8322-5a184ee46a50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.629942 Jul 19 15:36:33.741333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 362/728] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:33 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:33.896144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-a0d8dfc0-fa49-4afd-a0b9-1efb0de766ec req-4a79aae4-e33c-4f85-a5a7-379c111d0226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07929d52-360d-4bb4-99bf-aef1e30a9b6f", "name": "network-vif-deleted", "tag": "88c26c43-7e3b-4397-9280-7b9db97e3cc5"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:33.906426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a0d8dfc0-fa49-4afd-a0b9-1efb0de766ec req-4a79aae4-e33c-4f85-a5a7-379c111d0226 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:33.907297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-a0d8dfc0-fa49-4afd-a0b9-1efb0de766ec req-4a79aae4-e33c-4f85-a5a7-379c111d0226 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:33.921164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-a0d8dfc0-fa49-4afd-a0b9-1efb0de766ec req-4a79aae4-e33c-4f85-a5a7-379c111d0226 service nova] Creating event network-vif-deleted:88c26c43-7e3b-4397-9280-7b9db97e3cc5 for instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f on hv-cinder-84984 Jul 19 15:36:33.927331 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-a0d8dfc0-fa49-4afd-a0b9-1efb0de766ec req-4a79aae4-e33c-4f85-a5a7-379c111d0226 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035091 Jul 19 15:36:33.928219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 363/729] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:36:34.123360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:34.124082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:34.131105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.131644 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.132526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.133023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.215946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:34.224708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-41206242-6976-49d6-be50-3b6c4d7bfcf0 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.105983 Jul 19 15:36:34.225558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 364/730] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:34 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:34.231155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:34.231748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:34.238461 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.238904 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.239680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.240237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.423594 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:34.431867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:34.433452 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:34.434593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-18284a0e-1d45-4c7c-a245-05cb90b60c2a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.207855 Jul 19 15:36:34.435144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 365/731] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:34 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:34.757896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:34.758600 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:34.765527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.766080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.766931 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:34.767445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:34.942333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:34.952991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-794abc8a-1288-4e98-9bc6-f2f0a2692253 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.198773 Jul 19 15:36:34.953816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 366/732] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:34 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:35.243683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:35.245964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:35.252667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.253111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:35.254139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.254937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:35.357945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:35.360524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:35.367861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e4772afd-69f3-4969-b657-27f60078e087 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.128641 Jul 19 15:36:35.368530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 367/733] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:35 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:35.455020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:35.456056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:35.468918 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.469784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:35.470994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.471590 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:35.673416 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:35.682285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:35.684682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:35.686108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4593d08f-236d-47f0-98c1-d22e45657519 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.235655 Jul 19 15:36:35.686919 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 368/734] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:35 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:35.970852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:35.972283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:35.979395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.979892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:35.980614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:35.981039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:36.143714 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:36.158108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-719522d2-99c2-47a4-b3ca-699a37fa362b tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.191635 Jul 19 15:36:36.158704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 369/735] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:35 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:36.386158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:36.386158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:36.392888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:36.393630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:36.394902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:36.395589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:36.496597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:36.504773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0a698814-81c3-4ec2-b400-4e4005ccc72d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.123719 Jul 19 15:36:36.505485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 370/736] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:36 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:36.705065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:36.705708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:36.714995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:36.715428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:36.716213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:36.716639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:36.899692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:36.914177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:36.917758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:36.920392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e1e12df1-630b-4d11-9b35-408fd52a3635 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.219481 Jul 19 15:36:36.922764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 371/737] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:36 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:37.179717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:37.182045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:37.192253 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.192694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:37.193598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.194006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:37.366643 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:37.374568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4dff760a-152f-4259-b81b-f67af35f97f5 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.200224 Jul 19 15:36:37.375214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 372/738] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:37 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:37.522467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:37.523051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:37.529690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.530136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:37.530911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.531373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:37.600445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:37.608550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c14cc09b-ecff-46ef-a894-387147fd8082 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.090186 Jul 19 15:36:37.609378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 373/739] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:37 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:37.940119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:37.940689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:37.946918 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.948155 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:37.948980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:37.949444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:38.088450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:38.097035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:38.098578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:38.099753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-86e90631-663e-4754-b94b-0e93e49ecd76 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.163839 Jul 19 15:36:38.111069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 374/740] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:37 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:38.391991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:38.393385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:38.400890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:38.401334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:38.402118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:38.402558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:38.561655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:38.569924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-02816d38-c29d-4eab-af28-681d23bd28a4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.181670 Jul 19 15:36:38.571239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:38 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:38.626633 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:38.627271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:38.633393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:38.633845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:38.634809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:38.641204 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:38.720640 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:38.733721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-514a90ad-ce4c-4245-bdd1-30deaafe266d tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.111270 Jul 19 15:36:38.734426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 376/742] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:38 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:39.119239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:39.119654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:39.125661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.126106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.126867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.127300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.271655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:39.281324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:39.282932 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:39.284338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-443467c0-4cb9-4f24-8c02-346ee95c4574 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.169371 Jul 19 15:36:39.284976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 377/743] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:39 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:39.588215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:39.589336 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:39.595529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.595994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.596925 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.597428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.767072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:39.778366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cf98ccfa-1188-425b-ab6e-572e12c9bd82 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.194794 Jul 19 15:36:39.779205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 378/744] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:39 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:39.786579 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:39.788402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:39.795417 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.796057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.797581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:39.798061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:39.898392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:39.909372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c784d29c-856d-488e-9e21-964c68f2eed9 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.128838 Jul 19 15:36:39.912241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 379/745] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:39 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:40.303920 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:40.305266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:40.313301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.315983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:40.318321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.319428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:40.481916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:40.491109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:40.492598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:40.493812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1f20c55f-785e-46d1-bd6d-fc1f5d100cb0 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.194146 Jul 19 15:36:40.494814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 380/746] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:40 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:40.795450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:40.796167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:40.802083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.802529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:40.803301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.803751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:40.930225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:40.938541 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2165c357-5b41-410b-a64b-151281f74922 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.147107 Jul 19 15:36:40.939114 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 381/747] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:40 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:40.943399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:40.943995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:40.950301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.950750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:40.951514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:40.951949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:41.016508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:41.024241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9e128937-6c51-4c34-af7b-867080b2975f tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1466 microversion: 2.1 time: 0.084203 Jul 19 15:36:41.024795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 382/748] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:40 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1466 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:41.511777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:41.512374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:41.519032 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:41.519472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:41.520228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:41.520655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:41.653187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:41.661437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:41.662941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:41.664098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb8a7f45-b30e-4909-91a6-87d6c20ea82e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.156361 Jul 19 15:36:41.664707 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 383/749] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:41 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:36:41.955863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:41.956468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:41.962514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:41.962960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:41.963722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:41.965425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:41.980104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:42.147495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:42.156314 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-87409c3f-5e41-4e04-a1e4-b9fe98e729b3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.204264 Jul 19 15:36:42.156880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 384/750] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:41 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:42.161473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:42.162133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:42.168038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:42.168324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:42.169212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:42.169926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:42.170350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:42.178562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d2db63ea-b494-4c9d-97e0-f936472a3d64 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "POST /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.833595 Jul 19 15:36:42.179309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 367/751] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:36:33 2022] POST /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments => generated 194 bytes in 8836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:42.203153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:42.203526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:42.203972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lazy-loading 'fault' on Instance uuid 07929d52-360d-4bb4-99bf-aef1e30a9b6f {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:36:42.247492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:42.255423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-99494be7-dfda-4ead-9e29-028d130a8b93 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 200 len: 1312 microversion: 2.1 time: 0.097546 Jul 19 15:36:42.255987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 385/752] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:42 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:42.685332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:42.687372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:42.694885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:42.695343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:42.696107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:42.696536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:42.856818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:42.865214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:42.867144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:42.868301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bc753a55-5c53-4269-8975-5d41ac8700cc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.188957 Jul 19 15:36:42.873509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 368/753] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:42 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:43.173669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:43.174192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:43.180615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.181065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.181859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.182294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.273204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:43.273806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 07929d52-360d-4bb4-99bf-aef1e30a9b6f] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:43.281889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.282488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.283273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.283707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.298276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] HTTP exception thrown: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Request method failure captured: Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f HTTP/1.1 Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s5kjxTTWPkWpRKUKuTVlNF2k3dmirpjAJi92koCKFEFtpTmL0ovShxKBmUo6VasvyYl8dVOooHRSV7gpqVoVmmJP8pyg_Yzx00EkXiBNho-xdeVLSHUNzNZWwfnM1eRGjRqb1K7enOhS68iU4Y8ltqi36KF995_zWnV0gGrfnkiswo Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:43.299910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c3bc3582aa7420a9a1fcccacff362bd"}]}] Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 491d052f3d2947cea318b0753fffd1fa Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. Jul 19 15:36:43.301560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '07929d52-360d-4bb4-99bf-aef1e30a9b6f'} Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:43.302460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. Jul 19 15:36:43.303982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:43.305601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Returning 404 to user: Instance 07929d52-360d-4bb4-99bf-aef1e30a9b6f could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:43.305601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-984fdb9b-b15f-4f5b-80a8-e31b10d396e5 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f" status: 404 len: 111 microversion: 2.1 time: 0.032863 Jul 19 15:36:43.305601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 369/754] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:43 2022] GET /compute/v2.1/servers/07929d52-360d-4bb4-99bf-aef1e30a9b6f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:36:43.310459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:43.310942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:43.316785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.317255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.318028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.319700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.323530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:43.331685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-36d7205c-da48-40bd-aca6-a1931ca50c56 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.162031 Jul 19 15:36:43.332269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 386/755] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:43 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:43.345124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:36:43.422095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-475d0cec-de55-4a2c-a9c4-561f6e36219b tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "DELETE /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 204 len: 0 microversion: 2.1 time: 0.115693 Jul 19 15:36:43.423190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 370/756] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:43 2022] DELETE /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:43.431266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:43.431803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:43.438658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.439107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.439869 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.440303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.569116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:43.576754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-929a1649-08ca-466a-8224-f9ddbce9a508 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.149723 Jul 19 15:36:43.577355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 387/757] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:43 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:36:43.889328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:43.890092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:43.897094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.897578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:43.898336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:43.898764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:44.033021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:44.041170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:44.042677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:44.044552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05f3b2f2-d98d-480e-8d97-6ccc8ddf20bc tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.161661 Jul 19 15:36:44.045105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 371/758] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:43 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:44.350798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:44.351401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:44.358643 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:44.359096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:44.359865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:44.360301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:44.491338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:44.499402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39a86002-3c54-4412-a4ad-e6ca9dfbef86 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.152464 Jul 19 15:36:44.499962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 388/759] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:44 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:44.594200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:44.594803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:44.600887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:44.601388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:44.602190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:44.602628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:44.727198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:44.735329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4a722925-f442-4fae-b3b3-9e8afb1cd4b4 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.145540 Jul 19 15:36:44.735894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 372/760] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:44 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:45.062991 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:45.063711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:45.070041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.070572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.071427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.071929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.208009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:45.216468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:45.217990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:45.219139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-918f6a12-0cd2-48d7-83e1-2f525d942cbd tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.160253 Jul 19 15:36:45.219691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 389/761] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:45 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:45.516744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:45.517915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:45.524617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.525069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.525881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.526314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.707083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:45.715782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-444db7e6-53de-4ce5-9962-aa351f6450f9 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.203227 Jul 19 15:36:45.716808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 373/762] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:45 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:45.751739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:45.752256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:45.758787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.759238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.760010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:45.760450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:45.894110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:45.901913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c6582442-1ab4-4e8b-b860-4062ccd4ad6a tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1522 microversion: 2.1 time: 0.154040 Jul 19 15:36:45.903131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 390/763] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:45 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:46.237319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:46.237970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:46.240039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:46.245540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.246572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.247407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.247863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.377702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:46.385562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:46.388485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:46.389683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-11094e5f-9f03-444d-97c5-f8b2af5a2792 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.156340 Jul 19 15:36:46.390247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 374/764] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:46 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:46.734277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:46.734277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:46.740166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.740913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.741638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.742074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.923673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:46.924356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:46.932355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.933279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.935024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:46.935636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:46.994075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:47.010972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6eb9c609-857c-47bb-a107-6779d1d67965 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.279030 Jul 19 15:36:47.021254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 391/765] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:46 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:47.025202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-5f43bc1f-1b99-4cab-b22a-f52714c866ab req-74c28df2-9e71-4493-b91c-b864845124f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "751332f2-549d-4fc4-91f6-7c217bb044c4", "name": "network-vif-deleted", "tag": "2e2bf763-ea09-45dd-b98f-bb8d3f177ddc"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:47.035954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491d052f3d2947cea318b0753fffd1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3bc3582aa7420a9a1fcccacff362bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:47.044082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5f43bc1f-1b99-4cab-b22a-f52714c866ab req-74c28df2-9e71-4493-b91c-b864845124f6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:47.044560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-5f43bc1f-1b99-4cab-b22a-f52714c866ab req-74c28df2-9e71-4493-b91c-b864845124f6 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:47.051106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c8ca81cc-313c-4cd2-8e47-8193b6cb38e8 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 200 len: 1480 microversion: 2.1 time: 0.134638 Jul 19 15:36:47.052745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 375/766] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:46 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 1480 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:47.064262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-5f43bc1f-1b99-4cab-b22a-f52714c866ab req-74c28df2-9e71-4493-b91c-b864845124f6 service nova] Creating event network-vif-deleted:2e2bf763-ea09-45dd-b98f-bb8d3f177ddc for instance 751332f2-549d-4fc4-91f6-7c217bb044c4 on hv-cinder-84984 Jul 19 15:36:47.072119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-5f43bc1f-1b99-4cab-b22a-f52714c866ab req-74c28df2-9e71-4493-b91c-b864845124f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052451 Jul 19 15:36:47.077618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 392/767] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:47.224593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-c1b30cd0-392e-4986-be59-2e2b93298327 req-cad6c7ba-4c67-42b2-972d-7282183dc53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "name": "network-vif-plugged", "status": "completed", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:47.233579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-c1b30cd0-392e-4986-be59-2e2b93298327 req-cad6c7ba-4c67-42b2-972d-7282183dc53c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:47.234024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-c1b30cd0-392e-4986-be59-2e2b93298327 req-cad6c7ba-4c67-42b2-972d-7282183dc53c service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:47.247193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-c1b30cd0-392e-4986-be59-2e2b93298327 req-cad6c7ba-4c67-42b2-972d-7282183dc53c service nova] Creating event network-vif-plugged:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:36:47.255766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-c1b30cd0-392e-4986-be59-2e2b93298327 req-cad6c7ba-4c67-42b2-972d-7282183dc53c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034975 Jul 19 15:36:47.256407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 376/768] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:36:47.408983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:47.409777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:47.420229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:47.420681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:47.421523 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:47.421964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:47.576358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:47.585377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:47.586874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:47.588000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b21c5f60-41c1-4986-a27a-51e51c1c658e tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.183946 Jul 19 15:36:47.588554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 393/769] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:47 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:48.029663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:48.030345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:48.036493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.036933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.037730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.038160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.068617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:48.069261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] [instance: 751332f2-549d-4fc4-91f6-7c217bb044c4] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:48.076065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.076515 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.077320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.077759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.091616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] HTTP exception thrown: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Request method failure captured: Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 HTTP/1.1 Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s5kjxTTWPkWpRKUKuTVlNF2k3dmirpjAJi92koCKFEFtpTmL0ovShxKBmUo6VasvyYl8dVOooHRSV7gpqVoVmmJP8pyg_Yzx00EkXiBNho-xdeVLSHUNzNZWwfnM1eRGjRqb1K7enOhS68iU4Y8ltqi36KF995_zWnV0gGrfnkiswo Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:48.093294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c3bc3582aa7420a9a1fcccacff362bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c3bc3582aa7420a9a1fcccacff362bd"}]}] Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 8c3bc3582aa7420a9a1fcccacff362bd Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1352627042 Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 491d052f3d2947cea318b0753fffd1fa Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1352627042-project Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. Jul 19 15:36:48.094808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '751332f2-549d-4fc4-91f6-7c217bb044c4'} Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:48.095605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. Jul 19 15:36:48.096771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:48.097882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] Returning 404 to user: Instance 751332f2-549d-4fc4-91f6-7c217bb044c4 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:48.097882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9ffae093-c7a7-4f69-bf2b-86989d22d240 tempest-ServerRescueNegativeTestJSON-1352627042 tempest-ServerRescueNegativeTestJSON-1352627042-project] 10.222.0.42 "GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4" status: 404 len: 111 microversion: 2.1 time: 0.029866 Jul 19 15:36:48.097882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 394/770] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:48 2022] GET /compute/v2.1/servers/751332f2-549d-4fc4-91f6-7c217bb044c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:36:48.183049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:48.191241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3448b10f-dfe6-4ab7-abd7-db5a570972eb tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.166386 Jul 19 15:36:48.200669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 377/771] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:48 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:48.607037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:48.607728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:48.613934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.614453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.615288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:48.615815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:48.749019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:48.757163 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:48.758634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:48.759769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-01e14e24-efaf-46ef-aefd-3fada9513e42 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.157259 Jul 19 15:36:48.760314 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 395/772] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:48 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:49.207680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:49.208274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:49.215689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:49.216223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:49.217019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:49.217798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:49.393025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:49.401755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-30f122ba-5a84-4933-a2b5-97156800e307 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.197819 Jul 19 15:36:49.403324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 378/773] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:49 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:49.779967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:49.781498 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:49.789063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:49.789804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:49.791181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:49.792013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:50.038610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:50.047798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:50.051603 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:50.053317 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-17cdec9a-7c53-462e-8b11-a45a9aa4be29 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1731 microversion: 2.20 time: 0.279112 Jul 19 15:36:50.055021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 396/774] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:49 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:50.419910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:50.421098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:50.428221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:50.428942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:50.430671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:50.431325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:50.894595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:50.895069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:50.905751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:50.906409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:50.907802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:50.908464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:50.934679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:50.944801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9fd0622e-8505-49e7-9356-adacec372b99 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.529520 Jul 19 15:36:50.956763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 379/775] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:50 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:51.022897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lazy-loading 'services' on Instance uuid 14d75e24-cea7-4466-b728-5999cb2e2924 {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:36:51.077987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:51.078595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:51.086988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.087439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:51.093108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.093590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:51.139322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2f17f913-1b5f-49aa-be41-337fcb51d8fe tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments/b87fe91f-3aca-41a8-b7d2-652e2327af8c" status: 202 len: 0 microversion: 2.1 time: 0.248900 Jul 19 15:36:51.140760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 397/776] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:36:50 2022] DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments/b87fe91f-3aca-41a8-b7d2-652e2327af8c => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:51.172982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:51.176207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:51.184384 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.185708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:51.186909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.187509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:51.240296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ead9bcc9-6d36-49c3-8098-0405322ab7b5 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094937 Jul 19 15:36:51.241240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 398/777] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:51 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:51.332323 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:51.346925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:51.348689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:51.349891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d9846926-ab24-4c1d-a2b4-2d3fccbb5400 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1718 microversion: 2.20 time: 0.279508 Jul 19 15:36:51.350452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 380/778] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:36:51 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1718 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:36:51.962949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:51.963570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:51.982797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.983761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:51.984871 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:51.986059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.180199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:52.193636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1a329940-9593-478a-96bd-110294757743 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.234659 Jul 19 15:36:52.194747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 399/779] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:51 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:52.252168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:52.253583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:52.260975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.261611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.262517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.263091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.293667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f4ad937a-d85e-4b36-9a6a-d476348ac162 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044842 Jul 19 15:36:52.294234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 381/780] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:36:52 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:36:52.365310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:52.365813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:52.371997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.372434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.373407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.374464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.403343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:36:52.431168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:52.499575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a056f3cf-997c-4c62-b555-40036faf2c11 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 204 len: 0 microversion: 2.1 time: 0.137940 Jul 19 15:36:52.500536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 400/781] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:52 2022] DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:36:52.510168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:52.510866 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:52.518990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.519432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.520822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:52.521292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:52.729412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:52.740747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-34419ac4-85f0-4fdc-bafc-25e5a3fd1681 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1680 microversion: 2.1 time: 0.234442 Jul 19 15:36:52.741585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 382/782] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:52 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:53.199194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-e5aa3427-bae7-4348-ad90-2d06f708b703 req-9affc933-1df0-4d52-a6e4-a7d288c0ce3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "name": "network-vif-plugged", "status": "completed", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:53.213458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:53.217093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:53.232776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:53.233282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:53.234797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:53.235268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e5aa3427-bae7-4348-ad90-2d06f708b703 req-9affc933-1df0-4d52-a6e4-a7d288c0ce3e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:53.235892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-e5aa3427-bae7-4348-ad90-2d06f708b703 req-9affc933-1df0-4d52-a6e4-a7d288c0ce3e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:53.237403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:53.267793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-e5aa3427-bae7-4348-ad90-2d06f708b703 req-9affc933-1df0-4d52-a6e4-a7d288c0ce3e service nova] Creating event network-vif-plugged:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:36:53.273998 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-e5aa3427-bae7-4348-ad90-2d06f708b703 req-9affc933-1df0-4d52-a6e4-a7d288c0ce3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080588 Jul 19 15:36:53.275142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 401/783] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:53.430172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:53.445088 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-098c38e8-345a-433e-9791-58766585bd50 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.236918 Jul 19 15:36:53.446133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 383/784] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:53 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:53.762091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:53.762888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:53.771652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:53.772104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:53.773518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:53.773952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:53.919360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:53.927245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c66bdd9e-96c2-4aab-ae02-25a9eaaf10f8 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1680 microversion: 2.1 time: 0.170583 Jul 19 15:36:53.928171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 402/785] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:53 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:54.462372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:54.463040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:54.470203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:54.470658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:54.471443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:54.471879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:54.474719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:54.738426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:54.746320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1e77a929-cea7-45f8-b0f8-78c6c083f987 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1574 microversion: 2.1 time: 0.287798 Jul 19 15:36:54.746935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 384/786] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:54 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1574 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:54.944795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:54.945473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:54.954305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:54.954764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:54.955545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:54.955984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:55.041567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5507329a6bb84cfbbdac99b85f346ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af417e926a2d4d328a37fbb7baedbe78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:55.056085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c05f8bf2-5e73-412d-a4c2-071d528cc05c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 200 len: 1613 microversion: 2.1 time: 0.115373 Jul 19 15:36:55.057654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 403/787] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:54 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 1613 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:55.293560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-edd80268-13ae-4de0-891b-67158c906c41 req-06b3dd73-125e-4182-a2a2-180869466f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d75e24-cea7-4466-b728-5999cb2e2924", "name": "network-vif-deleted", "tag": "878a7fa3-8ed0-45e7-8682-0abc54bd15f2"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:36:55.308011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-edd80268-13ae-4de0-891b-67158c906c41 req-06b3dd73-125e-4182-a2a2-180869466f75 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:55.309293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-edd80268-13ae-4de0-891b-67158c906c41 req-06b3dd73-125e-4182-a2a2-180869466f75 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:55.332874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-edd80268-13ae-4de0-891b-67158c906c41 req-06b3dd73-125e-4182-a2a2-180869466f75 service nova] Creating event network-vif-deleted:878a7fa3-8ed0-45e7-8682-0abc54bd15f2 for instance 14d75e24-cea7-4466-b728-5999cb2e2924 on hv-cinder-84984 Jul 19 15:36:55.341698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-edd80268-13ae-4de0-891b-67158c906c41 req-06b3dd73-125e-4182-a2a2-180869466f75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051685 Jul 19 15:36:55.347038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 385/788] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:36:55.765314 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:55.766028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:55.769042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:55.777489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:55.778170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:55.779380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:55.779967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:55.987179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:36:56.003536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-48ad1039-33e7-4734-9538-b6e1c2b076ca tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1561 microversion: 2.1 time: 0.243964 Jul 19 15:36:56.004108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 404/789] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:55 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:36:56.076778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:56.078303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:56.088882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:56.089915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:56.090821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:56.091253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:56.106041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 HTTP/1.1 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:56.108047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:56.109562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '14d75e24-cea7-4466-b728-5999cb2e2924'} Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:56.110536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:56.112019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:56.113966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:56.115035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93f3ee05-a9d1-4fca-a3fb-b68d9f3bdd30 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 404 len: 111 microversion: 2.1 time: 0.044633 Jul 19 15:36:56.116178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 386/790] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:56 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:36:56.125200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-25390a2d-e991-4636-90d1-c52e5ffb46db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '.version_select at 0x7f8322b6a0d0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:56.149604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-25390a2d-e991-4636-90d1-c52e5ffb46db tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719103271" status: 202 len: 0 microversion: 2.1 time: 0.028779 Jul 19 15:36:56.150987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 405/791] 10.222.0.42 () {58 vars in 1220 bytes} [Tue Jul 19 15:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719103271 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:36:58.157994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:58.158452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:58.165102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:58.165695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:58.166530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:58.166968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:58.182262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 HTTP/1.1 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:58.184441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.186181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '14d75e24-cea7-4466-b728-5999cb2e2924'} Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:58.189946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.191458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.193440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:58.193440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6b4ef54d-8f0d-4eea-91db-aa2bd63d2bca tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 404 len: 111 microversion: 2.1 time: 0.031910 Jul 19 15:36:58.193440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 387/792] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:58 2022] DELETE /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:58.195356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:58.195978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 14d75e24-cea7-4466-b728-5999cb2e2924] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:58.202556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:58.203011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:58.203825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:58.204267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:58.218601 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 HTTP/1.1 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:58.220243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.221807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '14d75e24-cea7-4466-b728-5999cb2e2924'} Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:58.222646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. Jul 19 15:36:58.224061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:58.226057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 14d75e24-cea7-4466-b728-5999cb2e2924 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:58.226923 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f16ef606-7d6d-4455-8c2f-a33db5e2848f tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924" status: 404 len: 111 microversion: 2.1 time: 0.036198 Jul 19 15:36:58.227522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 406/793] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:58 2022] GET /compute/v2.1/servers/14d75e24-cea7-4466-b728-5999cb2e2924 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:59.383079 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:59.383549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:59.390747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.391189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.391974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.392403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.406384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c HTTP/1.1 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:59.408328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.409916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '3a25fda1-2381-4002-9308-d8ee3a03382c'} Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:59.410715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.411927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.413964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:59.414795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cbcc8325-b90e-45dd-bf42-bc6c73d0840a tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 404 len: 111 microversion: 2.1 time: 0.035726 Jul 19 15:36:59.415339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 388/794] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:59 2022] DELETE /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:59.423892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:59.424489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 3a25fda1-2381-4002-9308-d8ee3a03382c] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:59.431355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.431815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.432592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.433945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.447300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c HTTP/1.1 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:59.449497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.451052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '3a25fda1-2381-4002-9308-d8ee3a03382c'} Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:59.452001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. Jul 19 15:36:59.453286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.454527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 3a25fda1-2381-4002-9308-d8ee3a03382c could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:59.454527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3a45aef8-c0f1-4ce8-9b65-7489f955989e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c" status: 404 len: 111 microversion: 2.1 time: 0.030767 Jul 19 15:36:59.454527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 407/795] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:59 2022] GET /compute/v2.1/servers/3a25fda1-2381-4002-9308-d8ee3a03382c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:36:59.459505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:59.459839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:59.467328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.467773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.468557 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.468986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.484055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da HTTP/1.1 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:36:59.485780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.487375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'd8f4a1ee-aa79-4dad-917e-ba073bdbc3da'} Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:59.488208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.489693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.493096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:59.493096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d9d93b20-dbe2-4841-8318-28122c99b44d tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 404 len: 111 microversion: 2.1 time: 0.031563 Jul 19 15:36:59.493096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 389/796] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:36:59 2022] DELETE /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:36:59.496954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:59.497559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: d8f4a1ee-aa79-4dad-917e-ba073bdbc3da] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:36:59.503639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.504142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.505069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:59.505735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:59.521674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da HTTP/1.1 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:36:59.523750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.525355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'd8f4a1ee-aa79-4dad-917e-ba073bdbc3da'} Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:36:59.526313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. Jul 19 15:36:59.527838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:36:59.532808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance d8f4a1ee-aa79-4dad-917e-ba073bdbc3da could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:36:59.532808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a592fac9-08f6-4281-85f4-68d32c7bc96c tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da" status: 404 len: 111 microversion: 2.1 time: 0.034725 Jul 19 15:36:59.532808 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 408/797] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:36:59 2022] GET /compute/v2.1/servers/d8f4a1ee-aa79-4dad-917e-ba073bdbc3da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:37:00.843719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:00.844254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:00.850958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:00.851395 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:00.852326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:00.852755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:00.866966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 HTTP/1.1 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:00.868522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.869938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '9d78f8e2-17a7-4eb3-852f-369ee03e3630'} Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:00.870852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.873438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.875407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:00.875407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-56c851e7-78d3-4d67-9794-4fc0117de969 tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 404 len: 111 microversion: 2.1 time: 0.030852 Jul 19 15:37:00.875407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 390/798] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:37:00 2022] DELETE /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:37:00.879741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:00.880996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] [instance: 9d78f8e2-17a7-4eb3-852f-369ee03e3630] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:00.889324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:00.889779 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:00.890631 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:00.891074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:00.905772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] HTTP exception thrown: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Request method failure captured: Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 HTTP/1.1 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4YasQNOBzq2LUt30XLAtGjFR7GfRccE4Z_hN069-yTf_2D_ZreDCoXKlkgHyAOyAC_dms_ORWd94oDfkn1rr5EvEyfwLKSTjaxMKfvivR9sBVQEdYQ01xU7-lZrQTvqOHv-jZloXhJhZbLt8dmGVzy0WiwARgUBj-u2q9PPjk8vaw Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:00.907282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af417e926a2d4d328a37fbb7baedbe78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af417e926a2d4d328a37fbb7baedbe78"}]}] Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: af417e926a2d4d328a37fbb7baedbe78 Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1560940941 Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 5507329a6bb84cfbbdac99b85f346ab8 Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeNegativeTest-1560940941-project Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.908933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '9d78f8e2-17a7-4eb3-852f-369ee03e3630'} Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:00.909785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. Jul 19 15:37:00.911010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:00.912151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] Returning 404 to user: Instance 9d78f8e2-17a7-4eb3-852f-369ee03e3630 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:00.912151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8540bb5d-eae5-4e9b-9b34-bbf66bb7d77e tempest-AttachVolumeNegativeTest-1560940941 tempest-AttachVolumeNegativeTest-1560940941-project] 10.222.0.42 "GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630" status: 404 len: 111 microversion: 2.1 time: 0.033214 Jul 19 15:37:00.912151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 409/799] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:37:00 2022] GET /compute/v2.1/servers/9d78f8e2-17a7-4eb3-852f-369ee03e3630 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:37:41.360778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:41.361734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:41.363925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=33 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:41.364552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=17 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:41.370362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.370810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.371621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.372137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.405604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5d1a2334-913c-4809-9773-28cefbf8aecb tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049532 Jul 19 15:37:41.406155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 391/800] 10.222.0.42 () {60 vars in 1342 bytes} [Tue Jul 19 15:37:41 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:37:41.465289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:41.466565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:41.468872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:41.469716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:41.477598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.478053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.478819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.479255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.508680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:37:41.586789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-52fe0ba3-45df-4ab0-97ad-7e356e346994 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 204 len: 0 microversion: 2.20 time: 0.124941 Jul 19 15:37:41.587530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 410/801] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Jul 19 15:37:41 2022] DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 15:37:41.597376 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:41.598181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:41.604416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.604869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.605674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:41.606109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:41.749943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:41.759736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:41.761538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:41.764275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-72e4a4d0-1f76-490f-af96-709d55bf5eb8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.170053 Jul 19 15:37:41.765044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 392/802] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:41 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:37:42.783650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:42.784330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:42.791198 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:42.791584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:42.792353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:42.792782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:42.941337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:42.949456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:42.951038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:42.952186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a518dce3-eb8d-49ae-9c18-06cae3d836ac tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1724 microversion: 2.20 time: 0.172772 Jul 19 15:37:42.952725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 411/803] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:42 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:37:43.973319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:43.974782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:43.988966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:43.989632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:43.990847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:43.991286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:44.093628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:44.102977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:44.104856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ddb5e1dec1904ae183e131ba95ed1ef2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf94c44535545689ddc74bc82888a46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:37:44.106149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f18d300b-66b9-4991-8f2b-12493e2a649d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 200 len: 1656 microversion: 2.20 time: 0.138945 Jul 19 15:37:44.117521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 393/804] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:43 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:37:44.195423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-b9f7570f-615b-4057-9311-382cd1e1431b req-c8440d46-0fe7-4f08-968a-790536d1cf70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea9811c-e5c8-42c7-9ad8-f24db9070534", "name": "network-vif-deleted", "tag": "d4827091-3df3-4b42-9954-f3a1d6b0300f"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:44.206550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-b9f7570f-615b-4057-9311-382cd1e1431b req-c8440d46-0fe7-4f08-968a-790536d1cf70 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:44.207118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-b9f7570f-615b-4057-9311-382cd1e1431b req-c8440d46-0fe7-4f08-968a-790536d1cf70 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:44.221512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-b9f7570f-615b-4057-9311-382cd1e1431b req-c8440d46-0fe7-4f08-968a-790536d1cf70 service nova] Creating event network-vif-deleted:d4827091-3df3-4b42-9954-f3a1d6b0300f for instance eea9811c-e5c8-42c7-9ad8-f24db9070534 on hv-cinder-84984 Jul 19 15:37:44.228342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-b9f7570f-615b-4057-9311-382cd1e1431b req-c8440d46-0fe7-4f08-968a-790536d1cf70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036031 Jul 19 15:37:44.229481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 412/805] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:37:45.124640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:45.125895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:45.141201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:45.142734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:45.144176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:45.144622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:45.160119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 HTTP/1.1 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:45.161937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:45.163729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'eea9811c-e5c8-42c7-9ad8-f24db9070534'} Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:45.164710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:45.166309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:45.169850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:45.170968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20cfb60f-3979-463c-b0ba-1b69f9162711 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 404 len: 111 microversion: 2.20 time: 0.051170 Jul 19 15:37:45.172581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 394/806] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:45 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:45.181194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-59ffbd73-2523-4d27-9efe-e9db6bd3986a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '.version_select at 0x7f8322b6af70>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:45.203787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-59ffbd73-2523-4d27-9efe-e9db6bd3986a tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024998885" status: 204 len: 0 microversion: 2.20 time: 0.026712 Jul 19 15:37:45.204728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 413/807] 10.222.0.42 () {60 vars in 1261 bytes} [Tue Jul 19 15:37:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2024998885 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 15:37:47.282575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:47.283065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:47.290114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:47.290563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:47.291422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:47.291852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:47.305406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 HTTP/1.1 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:47.306939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.308587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': 'eea9811c-e5c8-42c7-9ad8-f24db9070534'} Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:47.309584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.311266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.312929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:47.312929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4bce5b6c-bbb4-4930-95c8-edc58c0530b8 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 404 len: 111 microversion: 2.20 time: 0.030336 Jul 19 15:37:47.312929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 395/808] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Jul 19 15:37:47 2022] DELETE /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:47.317556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:47.318265 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: eea9811c-e5c8-42c7-9ad8-f24db9070534] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:47.324449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:47.325502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:47.326363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:47.326795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:47.341855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 HTTP/1.1 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:47.343941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.345753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'eea9811c-e5c8-42c7-9ad8-f24db9070534'} Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:47.346678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. Jul 19 15:37:47.348069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:47.349791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance eea9811c-e5c8-42c7-9ad8-f24db9070534 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:47.349791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bc0f98c4-7203-450b-8b28-ced153f6c0ec tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534" status: 404 len: 111 microversion: 2.20 time: 0.032113 Jul 19 15:37:47.349791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 414/809] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:47 2022] GET /compute/v2.1/servers/eea9811c-e5c8-42c7-9ad8-f24db9070534 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:48.489020 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:48.489549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:48.497480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:48.498015 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:48.498780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:48.499207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:48.512122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 HTTP/1.1 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:48.514347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.515990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '6130f510-2f0f-4e30-9256-e9e1e590d9a7'} Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:48.516870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.518632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.520049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:48.520049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-21e52edb-4abd-4bf1-bf95-4f77a7f8302d tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 404 len: 111 microversion: 2.20 time: 0.030495 Jul 19 15:37:48.520049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 396/810] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Jul 19 15:37:48 2022] DELETE /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:48.524224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:48.524821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] [instance: 6130f510-2f0f-4e30-9256-e9e1e590d9a7] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:37:48.531373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:48.531816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:48.532567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:37:48.533019 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:37:48.546413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] HTTP exception thrown: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Request method failure captured: Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 HTTP/1.1 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s4Y0p2p9dnCYN6gmh_2sxm_vQHA1vqtz_kxrLavnlGnr9nw7w1z76vCHbrUsr25Q2sx-1eEsE-px8W79GFcNyHhTKy_kPeK3u5DX-qum5dfQUqWeyIKO3-GHR9LbRbFCpty4gPN9ejcqTSUADD1v5pmme70-r6qZSLGPthZ3YpPWhA Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:48.547888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9bf94c44535545689ddc74bc82888a46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9bf94c44535545689ddc74bc82888a46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9bf94c44535545689ddc74bc82888a46"}]}] Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 9bf94c44535545689ddc74bc82888a46 Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-503380296 Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: ddb5e1dec1904ae183e131ba95ed1ef2 Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-AttachVolumeShelveTestJSON-503380296-project Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.549556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '6130f510-2f0f-4e30-9256-e9e1e590d9a7'} Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:48.550427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. Jul 19 15:37:48.551875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:48.553175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] Returning 404 to user: Instance 6130f510-2f0f-4e30-9256-e9e1e590d9a7 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:48.553175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a5961b51-28a5-4f49-8cc4-8132371d7440 tempest-AttachVolumeShelveTestJSON-503380296 tempest-AttachVolumeShelveTestJSON-503380296-project] 10.222.0.42 "GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7" status: 404 len: 111 microversion: 2.20 time: 0.028847 Jul 19 15:37:48.553175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 415/811] 10.222.0.42 () {60 vars in 1276 bytes} [Tue Jul 19 15:37:48 2022] GET /compute/v2.1/servers/6130f510-2f0f-4e30-9256-e9e1e590d9a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:53.289750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cdd30309-5b2c-4be7-bee6-0b101cae3c32 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Action: 'create', calling method: .version_select at 0x7f83234424c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-575297228", "metadata": {"Type": "work"}}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cdd30309-5b2c-4be7-bee6-0b101cae3c32 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 121 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:53.314662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-575297228", "metadata": {"Type": "work"}}} Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: Jul 19 15:37:53.316215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-575297228', 'metadata': {'Type': 'work'}}}} Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.317071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:37:53.318682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:37:53.320134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:37:53.320134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.320134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cdd30309-5b2c-4be7-bee6-0b101cae3c32 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.320134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cdd30309-5b2c-4be7-bee6-0b101cae3c32 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.164239 Jul 19 15:37:53.320134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 397/812] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Jul 19 15:37:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:53.328078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0bb83e5-59bd-4c8e-92f3-b653537df7dc tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Action: 'create', calling method: .version_select at 0x7f8322bd5700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1171887522", "metadata": {"Type": "work"}}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0bb83e5-59bd-4c8e-92f3-b653537df7dc tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 120 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:53.331505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1171887522", "metadata": {"Type": "work"}}} Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:37:53.333269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1171887522', 'metadata': {'Type': 'work'}}}} Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi '0' Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.334369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:37:53.336232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:37:53.337854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:37:53.337854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.337854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0bb83e5-59bd-4c8e-92f3-b653537df7dc tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.337854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d0bb83e5-59bd-4c8e-92f3-b653537df7dc tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009521 Jul 19 15:37:53.337854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 416/813] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Jul 19 15:37:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:53.344930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-585129c8-daf3-4592-8f02-c5600e175832 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Action: 'create', calling method: .version_select at 0x7f8323404940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-370591636", "metadata": {"Type": "work"}}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-585129c8-daf3-4592-8f02-c5600e175832 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 118 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:53.349005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-370591636", "metadata": {"Type": "work"}}} Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: Jul 19 15:37:53.350537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-370591636', 'metadata': {'Type': 'work'}}}} Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi '' Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.351371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:37:53.352792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:37:53.353970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:37:53.353970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.353970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-585129c8-daf3-4592-8f02-c5600e175832 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.353970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-585129c8-daf3-4592-8f02-c5600e175832 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010116 Jul 19 15:37:53.353970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 398/814] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Jul 19 15:37:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:37:53.362319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1f3f82a5-7261-46be-b1d2-4b2df56636f9 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Calling method '.version_select at 0x7f8322b69310>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:53.394175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-1f3f82a5-7261-46be-b1d2-4b2df56636f9 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] HTTP exception thrown: Volume tempest-invalid-115130698 could not be found. Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1f3f82a5-7261-46be-b1d2-4b2df56636f9 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-115130698 HTTP/1.1 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:53.396161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Volume tempest-invalid-115130698 could not be found. Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'tempest-invalid-115130698'} Jul 19 15:37:53.397537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-115130698 could not be found. (HTTP 404) (Request-ID: req-8989ee2c-9bf4-4187-856e-e7a746464019) Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.398882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:37:53.400357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-115130698 could not be found. Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:53.401896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-115130698 could not be found. Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-115130698 could not be found. Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1f3f82a5-7261-46be-b1d2-4b2df56636f9 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 404 to user: Volume tempest-invalid-115130698 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1f3f82a5-7261-46be-b1d2-4b2df56636f9 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-115130698" status: 404 len: 98 microversion: 2.1 time: 0.040326 Jul 19 15:37:53.404446 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 417/815] 10.222.0.42 () {58 vars in 1214 bytes} [Tue Jul 19 15:37:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-115130698 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 15:37:53.409199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f1dad0e6-bf70-4d89-80bc-cc15b807dc41 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003856 Jul 19 15:37:53.409704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 399/816] 10.222.0.42 () {58 vars in 1139 bytes} [Tue Jul 19 15:37:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 15:37:53.418695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e8e38edc-7cad-4574-85b9-2be00c74f368 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003706 Jul 19 15:37:53.419184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 418/817] 10.222.0.42 () {58 vars in 1136 bytes} [Tue Jul 19 15:37:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 15:37:53.427374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-12efc21d-3dd1-4215-bb9c-06f83ded6257 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Calling method '.version_select at 0x7f83234740d0>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:53.457930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-12efc21d-3dd1-4215-bb9c-06f83ded6257 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] HTTP exception thrown: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-12efc21d-3dd1-4215-bb9c-06f83ded6257 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/os-volumes/45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 HTTP/1.1 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:37:53.459944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'id': '45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0'} Jul 19 15:37:53.461428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. (HTTP 404) (Request-ID: req-dce01680-e3f0-4325-9e4e-742f8813345d) Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.462280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:37:53.463437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:37:53.465577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-12efc21d-3dd1-4215-bb9c-06f83ded6257 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 404 to user: Volume 45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 could not be found. {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-12efc21d-3dd1-4215-bb9c-06f83ded6257 tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0" status: 404 len: 109 microversion: 2.1 time: 0.037690 Jul 19 15:37:53.467228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 400/818] 10.222.0.42 () {58 vars in 1247 bytes} [Tue Jul 19 15:37:53 2022] DELETE /compute/v2.1/os-volumes/45e65d9c-e6e4-43c1-b7c7-a3a24dc9fed0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:37:53.472307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-75ca1ac3-5d36-4219-851b-0ebdadc474fd tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Calling method '.version_select at 0x7f8322ce19d0>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:53.503962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-75ca1ac3-5d36-4219-851b-0ebdadc474fd tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] HTTP exception thrown: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-75ca1ac3-5d36-4219-851b-0ebdadc474fd tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Request method failure captured: Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/os-volumes/6dc07f76-7622-4a06-a341-7612134f35e0 HTTP/1.1 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s_R-fX9HFqSO1OXenHhiuRiThH9T6LKzQMGY_29LAFR9nvFyifJksOU2RjFukWjJ1kDtwFPHF1RuWQ6z983HkoGJIgWMjW7fhu6ZKL1ioHY_QTLPPRJ5wPnifar21wlJyg4z7zga3_1t0a0Hm1XG22iZICqkkLjzhY4OVHVTt79_48 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:37:53.505924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a767c10ce33549568e400d584e1c08f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a767c10ce33549568e400d584e1c08f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a767c10ce33549568e400d584e1c08f8"}]}] Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: a767c10ce33549568e400d584e1c08f8 Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesNegativeTest-1047168629 Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: 15ed522956fa457eabbec8d5f48924f0 Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesNegativeTest-1047168629-project Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '6dc07f76-7622-4a06-a341-7612134f35e0'} Jul 19 15:37:53.507423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. (HTTP 404) (Request-ID: req-120b6c3d-2742-4b62-adaa-91a59889f725) Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.508383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:37:53.509812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:37:53.511152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-75ca1ac3-5d36-4219-851b-0ebdadc474fd tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] Returning 404 to user: Volume 6dc07f76-7622-4a06-a341-7612134f35e0 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:37:53.513021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-75ca1ac3-5d36-4219-851b-0ebdadc474fd tempest-VolumesNegativeTest-1047168629 tempest-VolumesNegativeTest-1047168629-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/6dc07f76-7622-4a06-a341-7612134f35e0" status: 404 len: 109 microversion: 2.1 time: 0.039245 Jul 19 15:37:53.514069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 419/819] 10.222.0.42 () {58 vars in 1244 bytes} [Tue Jul 19 15:37:53 2022] GET /compute/v2.1/os-volumes/6dc07f76-7622-4a06-a341-7612134f35e0 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:38:14.788408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=12 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:14.789394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=24 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:14.795038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-349433399", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:14.844676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] validate_networks() for None {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:38:15.115003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:38:15.115423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:38:15.115916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:38:15.116320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:38:15.116724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:38:15.126110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:15.126548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:15.127331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:15.127757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:15.145207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Getting quotas for project 2e4fe057576e4bcba6647814498ca197. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:38:15.149033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Getting quotas for user d63df11e4d4344f3b1f6434c4e4a050a and project 2e4fe057576e4bcba6647814498ca197. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:38:15.160638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:38:15.162878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:38:15.205959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f704a6d8-605b-4750-945d-d91306049406 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.418701 Jul 19 15:38:15.206596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 401/820] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:38:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:38:15.215081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:15.215943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:15.219963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-db7c904b-f7ce-4c80-8459-c65bdb599aed tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:15.220568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-db7c904b-f7ce-4c80-8459-c65bdb599aed tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:15.280618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-db7c904b-f7ce-4c80-8459-c65bdb599aed tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:15.287610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-db7c904b-f7ce-4c80-8459-c65bdb599aed tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1214 microversion: 2.1 time: 0.074902 Jul 19 15:38:15.288140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 420/821] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:15 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:38:16.304467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:16.305206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:16.312994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:16.313574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:16.314436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:16.314958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:16.455745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:16.463157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-68df7461-87e0-493c-95c6-f4c8531e67cd tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1272 microversion: 2.1 time: 0.163112 Jul 19 15:38:16.463939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 402/822] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:16 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:17.480480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:17.481256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:17.487620 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:17.488075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:17.488850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:17.489324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:17.723164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:17.734531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0d3ef842-4e1b-47b6-867d-181e23360319 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.258345 Jul 19 15:38:17.735592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 421/823] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:17 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:17.864675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-acdf19f7-1e70-4165-a1c4-0b55637a6832 req-9020b6ab-d049-42e7-be94-3a053cd00cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc157f7-0eac-44ac-9665-519d6d645432", "tag": "c29769bf-5ccb-449f-94a1-e76ad955ecc1"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:17.875540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-acdf19f7-1e70-4165-a1c4-0b55637a6832 req-9020b6ab-d049-42e7-be94-3a053cd00cdd service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:17.876385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-acdf19f7-1e70-4165-a1c4-0b55637a6832 req-9020b6ab-d049-42e7-be94-3a053cd00cdd service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:17.894379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-acdf19f7-1e70-4165-a1c4-0b55637a6832 req-9020b6ab-d049-42e7-be94-3a053cd00cdd service nova] Creating event network-changed:c29769bf-5ccb-449f-94a1-e76ad955ecc1 for instance 2cc157f7-0eac-44ac-9665-519d6d645432 on hv-cinder-84984 Jul 19 15:38:17.900479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-acdf19f7-1e70-4165-a1c4-0b55637a6832 req-9020b6ab-d049-42e7-be94-3a053cd00cdd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038898 Jul 19 15:38:17.901680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 403/824] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:18.751622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:18.752269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:18.758790 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:18.759243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:18.760014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:18.760458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:18.895310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:18.903440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b15fc370-58df-460a-a492-2140c9b8e56e tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.155706 Jul 19 15:38:18.904020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 422/825] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:18 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:19.922199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:19.922877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:19.929712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:19.930359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:19.931125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:19.931559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:20.065949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:20.073880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b482979d-ff85-4ca5-a376-055a9c81373a tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.156645 Jul 19 15:38:20.074449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 404/826] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:19 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:21.092543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:21.093309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:21.104881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:21.105490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:21.106300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:21.106735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:21.253865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:21.262264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0f43016f-31d3-41b4-a58c-8a67c9e44894 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.174215 Jul 19 15:38:21.263050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 423/827] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:21 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:22.279830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:22.280537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:22.286995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:22.287431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:22.288180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:22.288607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:22.429383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:22.429648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f3a579f7-8365-4410-ab29-550b5506b6d9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.153675 Jul 19 15:38:22.430219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 405/828] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:22 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:23.446528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:23.447135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:23.454415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:23.454863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:23.455730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:23.456262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:23.586464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:23.594930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-594dcce8-64a6-4adb-b07c-65352816a7bc tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.152205 Jul 19 15:38:23.595589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 424/829] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:23 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:23.836602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-ea9957d1-b8ad-42a4-b000-7e72bbddef06 req-afdc7b78-a65e-4584-98a4-4917ae481281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc157f7-0eac-44ac-9665-519d6d645432", "name": "network-vif-plugged", "status": "completed", "tag": "c29769bf-5ccb-449f-94a1-e76ad955ecc1"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:23.845330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ea9957d1-b8ad-42a4-b000-7e72bbddef06 req-afdc7b78-a65e-4584-98a4-4917ae481281 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:23.845784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ea9957d1-b8ad-42a4-b000-7e72bbddef06 req-afdc7b78-a65e-4584-98a4-4917ae481281 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:23.858059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-ea9957d1-b8ad-42a4-b000-7e72bbddef06 req-afdc7b78-a65e-4584-98a4-4917ae481281 service nova] Creating event network-vif-plugged:c29769bf-5ccb-449f-94a1-e76ad955ecc1 for instance 2cc157f7-0eac-44ac-9665-519d6d645432 on hv-cinder-84984 Jul 19 15:38:23.862731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-ea9957d1-b8ad-42a4-b000-7e72bbddef06 req-afdc7b78-a65e-4584-98a4-4917ae481281 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 Jul 19 15:38:23.863311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 406/830] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:24.611661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:24.612266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:24.618657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:24.619105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:24.620475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:24.621056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:24.751652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:24.759056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-02d83989-1c12-4487-8afd-065198bd04b4 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.151185 Jul 19 15:38:24.759617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 425/831] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:24 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:38:25.782269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:25.782852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:25.787809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:25.793607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:25.798979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:25.799432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:25.800222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:25.800653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:25.951062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:25.958392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-897c9a3a-f806-48b6-b692-7fd534d3dde1 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.182217 Jul 19 15:38:25.958948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 407/832] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:25 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:26.975821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:26.976507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:26.978549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:26.984988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:26.985460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:26.986237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:26.986674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:27.126682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:27.134185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e37afea3-c6bd-412c-ae1a-3c622a076592 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1314 microversion: 2.1 time: 0.162310 Jul 19 15:38:27.134940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 426/833] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:26 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:28.153015 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:28.153648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:28.160025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.160474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.161270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.161705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.294131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:28.302927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-37b73c5f-ec5a-426c-b92d-ec5644ede289 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1464 microversion: 2.1 time: 0.154100 Jul 19 15:38:28.303495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 408/834] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:28 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:28.343633 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:28.344160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:28.350449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.350884 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.351637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.352062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.377456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:38:28.452628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d0b5e17c-ac81-4f89-b0e7-2f129db25a77 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 204 len: 0 microversion: 2.1 time: 0.112345 Jul 19 15:38:28.453385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 427/835] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:38:28 2022] DELETE /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:38:28.461926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:28.462531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:28.468574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.469017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.469819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:28.470249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:28.603480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:28.611697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-18a28d36-d948-49c0-9415-f39a1fb1f65b tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1470 microversion: 2.1 time: 0.153536 Jul 19 15:38:28.612247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 409/836] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:28 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:29.631597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:29.632279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:29.639667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:29.640110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:29.640859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:29.641589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:29.799542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd63df11e4d4344f3b1f6434c4e4a050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e4fe057576e4bcba6647814498ca197', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:29.807637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-241b9c7b-ba6a-4bbe-abf1-4fdb7986b2a9 tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 200 len: 1470 microversion: 2.1 time: 0.179579 Jul 19 15:38:29.808419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 428/837] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:29 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:30.214425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-46c2c8ae-d09f-49cd-91de-bfa720228904 req-c0375143-368e-46b7-8b70-7620e24db096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc157f7-0eac-44ac-9665-519d6d645432", "name": "network-vif-deleted", "tag": "c29769bf-5ccb-449f-94a1-e76ad955ecc1"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:30.223490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-46c2c8ae-d09f-49cd-91de-bfa720228904 req-c0375143-368e-46b7-8b70-7620e24db096 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:30.223940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-46c2c8ae-d09f-49cd-91de-bfa720228904 req-c0375143-368e-46b7-8b70-7620e24db096 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:30.237786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-46c2c8ae-d09f-49cd-91de-bfa720228904 req-c0375143-368e-46b7-8b70-7620e24db096 service nova] Creating event network-vif-deleted:c29769bf-5ccb-449f-94a1-e76ad955ecc1 for instance 2cc157f7-0eac-44ac-9665-519d6d645432 on hv-cinder-84984 Jul 19 15:38:30.242985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-46c2c8ae-d09f-49cd-91de-bfa720228904 req-c0375143-368e-46b7-8b70-7620e24db096 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033186 Jul 19 15:38:30.243587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 410/838] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:30.825869 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:30.827572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] [instance: 2cc157f7-0eac-44ac-9665-519d6d645432] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:30.834392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:30.834948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:30.835784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:30.836220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:30.849512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] HTTP exception thrown: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Request method failure captured: Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 HTTP/1.1 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s_lNrUNLHrxD5fMaxSbvJW0Je2EpZcu5hLmVLDTHzNvOwrJMDWabXrVUEG5mpqGHx2a75HH1sF2HU35UktCW_l1nRFQGZZJFejboZj5rt5hCBjMjrTxzyPgvEd_0GLJu1SKWhjOs6a3Mo-sB9jzHpGmqAx3rcvuARCpzM98sZR7xJw Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 2e4fe057576e4bcba6647814498ca197 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-VolumesNegativeTest-578710851 Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:38:30.851129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2e4fe057576e4bcba6647814498ca197"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e4fe057576e4bcba6647814498ca197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2e4fe057576e4bcba6647814498ca197"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2e4fe057576e4bcba6647814498ca197"}]}] Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-VolumesNegativeTest-578710851 Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 2e4fe057576e4bcba6647814498ca197 Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-VolumesNegativeTest-578710851 Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-VolumesNegativeTest-578710851-project Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: d63df11e4d4344f3b1f6434c4e4a050a Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-VolumesNegativeTest-578710851-project Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. Jul 19 15:38:30.852845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': '2cc157f7-0eac-44ac-9665-519d6d645432'} Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:30.854481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. Jul 19 15:38:30.856131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:30.857373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] Returning 404 to user: Instance 2cc157f7-0eac-44ac-9665-519d6d645432 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:30.857373 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b80ec9ad-6473-4b0b-b9e6-7f8c5b4d48eb tempest-VolumesNegativeTest-578710851 tempest-VolumesNegativeTest-578710851-project] 10.222.0.42 "GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432" status: 404 len: 111 microversion: 2.1 time: 0.031445 Jul 19 15:38:30.858610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 429/839] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:30 2022] GET /compute/v2.1/servers/2cc157f7-0eac-44ac-9665-519d6d645432 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:38:34.031962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-451547960", "imageRef": "9227a608-2e79-420a-8047-da7b16b6a245", "flavorRef": "452", "networks": [{"uuid": "9b022760-fc9c-4760-bc00-4f879c71370c"}]}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:34.084254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] validate_networks() for [('9b022760-fc9c-4760-bc00-4f879c71370c', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:38:34.675074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:38:34.675496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:38:34.675964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:38:34.676368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:38:34.676801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:38:34.686369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:34.686809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:34.687600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:34.688032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:34.704917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Getting quotas for project a1e0f23ca7114ecea8330a41af830c22. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:38:34.709050 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Getting quotas for user 746f7b2b60694c8a87a80f8801204345 and project a1e0f23ca7114ecea8330a41af830c22. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:38:34.720168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:38:34.722554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9227a608-2e79-420a-8047-da7b16b6a245',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:38:34.767206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0f4bb23c-e1bc-47fa-8a10-3fe13d76eacb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740164 Jul 19 15:38:34.767879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 411/840] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:38:34.778391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d06cdc3f-90f8-439e-8338-cd9cfdbc9520 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:34.779148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d06cdc3f-90f8-439e-8338-cd9cfdbc9520 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:34.831953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d06cdc3f-90f8-439e-8338-cd9cfdbc9520 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:34.840245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d06cdc3f-90f8-439e-8338-cd9cfdbc9520 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1218 microversion: 2.1 time: 0.066280 Jul 19 15:38:34.840830 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 430/841] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:35.858053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:35.858675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:35.868904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:35.869910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:35.873610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:35.874283 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:35.982940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:35.993454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c58b247b-9a3d-4883-b29e-1aa1e59ccd39 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1276 microversion: 2.1 time: 0.140139 Jul 19 15:38:35.994981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 412/842] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1276 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:36.327313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:36.328385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:36.343072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:36.343642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:36.345510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:36.347598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:36.381603 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:38:36.520396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dcc91de4-25b2-450f-a3a1-ae519efa69d1 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 204 len: 0 microversion: 2.1 time: 0.198993 Jul 19 15:38:36.526061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 431/843] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:38:36 2022] DELETE /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:38:36.535223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:36.536154 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:36.544566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:36.545322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:36.546354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:36.546971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:36.625227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-5e2d55bc-71f6-4415-b580-83708d6f2e28 req-ca79fb50-3ef9-4a28-8f00-b560229c424d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:36.634405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-5e2d55bc-71f6-4415-b580-83708d6f2e28 req-ca79fb50-3ef9-4a28-8f00-b560229c424d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:36.635949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-5e2d55bc-71f6-4415-b580-83708d6f2e28 req-ca79fb50-3ef9-4a28-8f00-b560229c424d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:36.654563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-5e2d55bc-71f6-4415-b580-83708d6f2e28 req-ca79fb50-3ef9-4a28-8f00-b560229c424d service nova] Creating event network-changed:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:38:36.659674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-5e2d55bc-71f6-4415-b580-83708d6f2e28 req-ca79fb50-3ef9-4a28-8f00-b560229c424d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.334508 Jul 19 15:38:36.660573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 413/844] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:38:36.724245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:36.732774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-68f19a61-0477-4f21-8394-1e07935081c4 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.205135 Jul 19 15:38:36.733301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 432/845] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:36 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:38:37.018842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:37.020756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:37.031879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:37.032348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:37.033409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:37.033796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:37.194228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:37.209422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-82277055-ee5b-40ac-9f0d-cf41442e74d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.201562 Jul 19 15:38:37.210556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 414/846] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:37.751152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:37.751954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:37.759379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:37.760693 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:37.761847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:37.762589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:38.238817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.241528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:38.249497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:38.249962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:38.250730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:38.251287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:38.409825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:38.419440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1d038a23-66a7-4940-8a10-ba468f20f8c3 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1567 microversion: 2.1 time: 0.672366 Jul 19 15:38:38.421198 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 433/847] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:37 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1567 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:38.737241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:38.747641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-32c9e299-13c1-4350-aef3-d51742a27f88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.521815 Jul 19 15:38:38.748678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 415/848] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:38.938633 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-8b37fa18-0503-438c-aa56-ef762fc821fb req-e9827bcf-fda9-4c10-8a4f-ed9f135adb24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae776f5e-076c-42bb-bd62-8f3afdff9746", "name": "network-vif-deleted", "tag": "aa0a600b-d7b3-407a-9518-974d4006c608"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:38.950517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8b37fa18-0503-438c-aa56-ef762fc821fb req-e9827bcf-fda9-4c10-8a4f-ed9f135adb24 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:38.954096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-8b37fa18-0503-438c-aa56-ef762fc821fb req-e9827bcf-fda9-4c10-8a4f-ed9f135adb24 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.146462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-8b37fa18-0503-438c-aa56-ef762fc821fb req-e9827bcf-fda9-4c10-8a4f-ed9f135adb24 service nova] Creating event network-vif-deleted:aa0a600b-d7b3-407a-9518-974d4006c608 for instance ae776f5e-076c-42bb-bd62-8f3afdff9746 on hv-cinder-84984 Jul 19 15:38:39.152944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-8b37fa18-0503-438c-aa56-ef762fc821fb req-e9827bcf-fda9-4c10-8a4f-ed9f135adb24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219434 Jul 19 15:38:39.153799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 434/849] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:39.439202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:39.439832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:39.446755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.447916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.448675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.449351 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.490119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.490800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.491811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lazy-loading 'fault' on Instance uuid ae776f5e-076c-42bb-bd62-8f3afdff9746 {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:38:39.586089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee7cef53eb641bb93c92e3c524c59db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '286e8f4ce0854bf3a8563bcea08ae93a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:39.593975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c8b5b4b8-15cd-428a-971d-abcf029f9bbc tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 200 len: 1225 microversion: 2.1 time: 0.159009 Jul 19 15:38:39.603891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 416/850] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:39 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 1225 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:39.724113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-89104ee0-53c3-480a-99c6-e4ebead424be req-af324c13-6533-42c3-8384-8529f2540266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74175f5a-2462-4fe9-9ad7-d6a5b60f62cc", "tag": "0a49ec3b-6974-4be8-ae96-68813b154d1a"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:39.738514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-89104ee0-53c3-480a-99c6-e4ebead424be req-af324c13-6533-42c3-8384-8529f2540266 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.738946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-89104ee0-53c3-480a-99c6-e4ebead424be req-af324c13-6533-42c3-8384-8529f2540266 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.756403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-89104ee0-53c3-480a-99c6-e4ebead424be req-af324c13-6533-42c3-8384-8529f2540266 service nova] Creating event network-changed:0a49ec3b-6974-4be8-ae96-68813b154d1a for instance 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc on hv-cinder-84984 Jul 19 15:38:39.765509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:39.766615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:39.772966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.773686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.774639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:39.775389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:39.782138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-89104ee0-53c3-480a-99c6-e4ebead424be req-af324c13-6533-42c3-8384-8529f2540266 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063362 Jul 19 15:38:39.792980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 435/851] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:40.116544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:40.128881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-88d538e5-a451-426e-84cb-6b28ba5eb13b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.367254 Jul 19 15:38:40.129782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 417/852] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:39 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:40.611660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:40.612469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [instance: ae776f5e-076c-42bb-bd62-8f3afdff9746] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:40.618502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:40.618947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:40.619719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:40.620142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:40.633187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.wsgi [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] HTTP exception thrown: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Request method failure captured: Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: request: GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 HTTP/1.1 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept: application/json Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Accept-Encoding: identity Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Connection: close Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Length: 0 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Content-Type: application/json Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Host: 10.222.0.42 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Openstack-System-Scope: None Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: User-Agent: python-urllib3/1.26.9 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Auth-Token: gAAAAABi1s6tM5mj_T789OHEuurYxMtxXLsm6GFL3O5JX1ecz3TUlJ6gz1CmMT0nizaoSaXnGFm9HRxgLKNeJ8qXZEDtSqqrZAfX0hwvnCcXX1wrrj-X4x1ZNjudeSKFvtoMrXTh2EyslUqFKUBlfLl8_GDb6Ff0EN2Ayt7xbr9NMOB9ml84Od0 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Id: None Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Domain-Name: None Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Identity-Status: Confirmed Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Is-Admin-Project: True Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Id: default Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Domain-Name: Default Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Id: 286e8f4ce0854bf3a8563bcea08ae93a Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Project-Name: tempest-TestShelveInstance-1783410092 Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Role: reader,member Jul 19 15:38:40.635350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Roles: reader,member Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_286e8f4ce0854bf3a8563bcea08ae93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/286e8f4ce0854bf3a8563bcea08ae93a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/286e8f4ce0854bf3a8563bcea08ae93a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/286e8f4ce0854bf3a8563bcea08ae93a"}]}] Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant: tempest-TestShelveInstance-1783410092 Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Id: 286e8f4ce0854bf3a8563bcea08ae93a Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-Tenant-Name: tempest-TestShelveInstance-1783410092 Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User: tempest-TestShelveInstance-1783410092-project Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Id: default Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Domain-Name: Default Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Id: dee7cef53eb641bb93c92e3c524c59db Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: X-User-Name: tempest-TestShelveInstance-1783410092-project Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: method: > Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: exception: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. Jul 19 15:38:40.637006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: action_args: {'id': 'ae776f5e-076c-42bb-bd62-8f3afdff9746'} Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:40.638285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. Jul 19 15:38:40.639822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.642457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Returning 404 to user: Instance ae776f5e-076c-42bb-bd62-8f3afdff9746 could not be found. {{(pid=118006) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:40.642457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-73e9de8f-8dac-49c5-8f90-85d2b10b7c93 tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746" status: 404 len: 111 microversion: 2.1 time: 0.029777 Jul 19 15:38:40.642457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 436/853] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:40 2022] GET /compute/v2.1/servers/ae776f5e-076c-42bb-bd62-8f3afdff9746 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:38:40.996000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8a0ddd73-89e5-4be9-9357-b1b318ed77ec tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] Calling method '.version_select at 0x7f8323442790>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.000294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a0ddd73-89e5-4be9-9357-b1b318ed77ec tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [a37347ff-b65c-41c4-a2e1-f3dbc4446119] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 15:38:41.151063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.151700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:41.160374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:41.161073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:41.162066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:41.162653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:41.437480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:41.444028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:41.457821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8f853f1b-135b-42ab-b8cf-a42d637a8cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.314595 Jul 19 15:38:41.458256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 437/854] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:42.008269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a0ddd73-89e5-4be9-9357-b1b318ed77ec tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] [a37347ff-b65c-41c4-a2e1-f3dbc4446119] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 35010. Jul 19 15:38:42.029758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8a0ddd73-89e5-4be9-9357-b1b318ed77ec tempest-TestShelveInstance-1783410092 tempest-TestShelveInstance-1783410092-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1111119745" status: 202 len: 0 microversion: 2.1 time: 1.038634 Jul 19 15:38:42.034975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 418/855] 10.222.0.42 () {58 vars in 1253 bytes} [Tue Jul 19 15:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1111119745 => generated 0 bytes in 1040 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:38:42.475688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:42.476297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:42.489381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:42.490279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:42.491414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:42.492009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:42.998508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:43.011118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3c3a324c-b921-4edc-9319-0207a0801b8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.539922 Jul 19 15:38:43.012434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 438/856] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:44.032163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:44.032887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:44.048456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:44.049589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:44.052198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:44.054856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:44.380611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:44.389759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1c46a479-ab86-4082-9652-7eebbac22d0f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.363429 Jul 19 15:38:44.390493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 419/857] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:45.408875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:45.410099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:45.413977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:45.415050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:45.422195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:45.422974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:45.424638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:45.425423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:45.660368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:45.671577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-feb840c6-c468-4635-880b-e194a3008a75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.267337 Jul 19 15:38:45.672627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 439/858] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:46.691536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:46.692427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:46.699105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.700341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.704004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.706385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:46.707427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:46.708801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:46.709934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:46.720970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=87 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:46.733514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-1fc60b59-2419-46f2-a4c3-308f95e7bea7 req-89fb741c-22c8-4912-b350-4b754c7390ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74175f5a-2462-4fe9-9ad7-d6a5b60f62cc", "name": "network-vif-plugged", "status": "completed", "tag": "0a49ec3b-6974-4be8-ae96-68813b154d1a"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:46.748436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-1fc60b59-2419-46f2-a4c3-308f95e7bea7 req-89fb741c-22c8-4912-b350-4b754c7390ee service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:46.749538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-1fc60b59-2419-46f2-a4c3-308f95e7bea7 req-89fb741c-22c8-4912-b350-4b754c7390ee service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:46.763189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-1fc60b59-2419-46f2-a4c3-308f95e7bea7 req-89fb741c-22c8-4912-b350-4b754c7390ee service nova] Creating event network-vif-plugged:0a49ec3b-6974-4be8-ae96-68813b154d1a for instance 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc on hv-cinder-84984 Jul 19 15:38:46.775648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-1fc60b59-2419-46f2-a4c3-308f95e7bea7 req-89fb741c-22c8-4912-b350-4b754c7390ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047657 Jul 19 15:38:46.776880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 440/859] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:38:46.888275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:46.897628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-961eadf1-a002-4ac8-9e15-54629e0ac247 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.212476 Jul 19 15:38:46.911233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 420/860] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:47.916606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:47.917466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:47.927593 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:47.934370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:47.935508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:47.938187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:48.312746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:48.323139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-de9226d3-1af2-41c7-866c-728881285cf8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1318 microversion: 2.1 time: 0.411040 Jul 19 15:38:48.328874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 441/861] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:49.352202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:49.354905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:38:49.378537 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:49.379959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:49.380922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:38:49.382484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:38:49.756529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:38:49.775589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4e3f50fb-42e0-4720-8666-b250de24bd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1506 microversion: 2.1 time: 0.425430 Jul 19 15:38:49.776449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 421/862] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:38:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:00.964563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c547cc90-29cf-4269-ba84-cce17a85c965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'create', calling method: .version_select at 0x7f8322d3ce50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2123048029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfBN4bcBZkmRUNNYzoKmozU/78T73DUQvUcBdffHwlwqTrq7f3EcAE1Iu8cPdT7BsAvMv+h3wxho4u/DHi9JSVSGJX4k0lhBxrVrhJ5CODMg3pOdHeGmvfWZDihKLTslQ=="}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:00.969060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=5 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:00.969719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=20 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:00.981842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-c547cc90-29cf-4269-ba84-cce17a85c965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Getting quotas for project 05857a00bdb14c54800b5e0f55ed27fc. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:39:00.985628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.quota [None req-c547cc90-29cf-4269-ba84-cce17a85c965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Getting quotas for user 15af8262a49946739a79f12ec7f8b15d and project 05857a00bdb14c54800b5e0f55ed27fc. Resources: {'key_pairs'} {{(pid=118006) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:39:01.006425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c547cc90-29cf-4269-ba84-cce17a85c965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046386 Jul 19 15:39:01.006994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 442/863] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:39:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:01.107346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1659616919", "imageRef": "8318f0b7-3c47-4f10-98d5-d1077cb16c48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2123048029", "networks": [{"uuid": "36d735bd-375c-43a3-84ed-6f1f0023ecfb"}]}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:01.114572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:01.115233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=11 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:01.161127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.network.neutron [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] validate_networks() for [('36d735bd-375c-43a3-84ed-6f1f0023ecfb', None, None, None, None, None)] {{(pid=118007) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:39:01.535711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Flavor limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:39:01.536177 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Image limits 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:39:01.536645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Flavor pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:39:01.537049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Image pref 0:0:0 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:39:01.537481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.virt.hardware [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118007) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:39:01.546632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:01.547068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:01.547860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:01.548291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:01.564938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Getting quotas for project 05857a00bdb14c54800b5e0f55ed27fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:39:01.568860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Getting quotas for user 15af8262a49946739a79f12ec7f8b15d and project 05857a00bdb14c54800b5e0f55ed27fc. Resources: {'cores', 'ram', 'instances'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:39:01.580242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Going to run 1 instances... {{(pid=118007) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:39:01.582490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8318f0b7-3c47-4f10-98d5-d1077cb16c48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118007) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:39:01.626891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-230e2e3e-bd45-48cb-a381-2e732201f605 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523420 Jul 19 15:39:01.627513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 422/864] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Jul 19 15:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:39:01.638222 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-220757ac-1970-49ca-ac6c-ca0f25d80ad5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:01.638829 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-220757ac-1970-49ca-ac6c-ca0f25d80ad5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:01.696774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-220757ac-1970-49ca-ac6c-ca0f25d80ad5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:01.705968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-220757ac-1970-49ca-ac6c-ca0f25d80ad5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1259 microversion: 2.1 time: 0.072425 Jul 19 15:39:01.707144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 443/865] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:02.724276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:02.725440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:02.735887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:02.736988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:02.738041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:02.738760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:02.833672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:02.842480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0a193fdb-f61e-49b4-be38-3865eab54f29 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1317 microversion: 2.1 time: 0.122988 Jul 19 15:39:02.847049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 423/866] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1317 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:03.862139 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:03.864360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:03.873891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:03.874407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:03.875268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:03.875702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:04.012704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:04.023637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7f21abe4-9c24-4f87-85a1-485c7bb11003 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.166223 Jul 19 15:39:04.024716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 444/867] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:05.041598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:05.042199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:05.048589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:05.049037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:05.049842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:05.050276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:05.201123 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:05.209035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-51371c43-d618-4607-8a79-1ef70aed5dff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.171757 Jul 19 15:39:05.213299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 424/868] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:05.448363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a58cb7c1-58e7-47a2-835a-26892967d0a8", "device": "/dev/sdb"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:05.450137 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:05.456687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:05.457167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:05.457959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:05.458400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:06.226011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:06.227215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:06.233890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:06.234333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:06.235098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:06.235525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:06.380396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:06.388399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ee0743ce-0213-405e-8809-b04f9e3608a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.166216 Jul 19 15:39:06.388948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 425/869] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:07.405494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:07.406120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:07.412603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:07.413052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:07.413859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:07.414867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:07.563815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:07.571301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cf9e4b48-a0d4-422f-899c-76c9aa70165d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.169710 Jul 19 15:39:07.571922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 426/870] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:08.587977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:08.588628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:08.595070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:08.595517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:08.596282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:08.596715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:08.735816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:08.744171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d589d958-96e5-449d-8121-48d85bd19893 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.160081 Jul 19 15:39:08.744774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 427/871] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:09.763570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:09.764292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:09.771718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:09.772196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:09.772993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:09.773464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:09.916018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:09.923547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9aa32990-881d-4202-82e0-3a090d38f19b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.165832 Jul 19 15:39:09.924119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 428/872] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:10.939820 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:10.940513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:10.947533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:10.947976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:10.948734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:10.949182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:11.079444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:11.088708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2a15617b-eae0-435d-b924-1ece3100cc43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.152699 Jul 19 15:39:11.089334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 429/873] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:11.363597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-38ac18ba-c718-4539-8302-606c59c5fae5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "POST /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.919441 Jul 19 15:39:11.364319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 445/874] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:39:05 2022] POST /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc/os-volume_attachments => generated 194 bytes in 5921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:11.860972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-6713682b-0f98-44cc-b0f8-84c0cd069d2f req-50d1bac6-262d-4620-8ba5-0eeabc49e420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:11.873383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=2 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:11.875324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=6 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:11.878434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-6713682b-0f98-44cc-b0f8-84c0cd069d2f req-50d1bac6-262d-4620-8ba5-0eeabc49e420 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:11.878880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-6713682b-0f98-44cc-b0f8-84c0cd069d2f req-50d1bac6-262d-4620-8ba5-0eeabc49e420 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:11.891946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-6713682b-0f98-44cc-b0f8-84c0cd069d2f req-50d1bac6-262d-4620-8ba5-0eeabc49e420 service nova] Creating event network-changed:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:39:11.897700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-6713682b-0f98-44cc-b0f8-84c0cd069d2f req-50d1bac6-262d-4620-8ba5-0eeabc49e420 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047506 Jul 19 15:39:11.899263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 430/875] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:12.106104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:12.106804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:12.109211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=6 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:12.115539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:12.115996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:12.116779 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:12.117324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:12.303988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:12.311947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b3857a23-dc75-41c6-8c3c-d899366af5e1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.210057 Jul 19 15:39:12.312506 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 446/876] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:13.330752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:13.331468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:13.338504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:13.338948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:13.339711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:13.340141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:13.545832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:13.553187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b7f5bb61-7519-4693-bd65-8f19173e9637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.227150 Jul 19 15:39:13.553742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 431/877] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:14.571730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:14.572365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:14.578676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:14.579173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:14.580252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:14.580871 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:14.711493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:14.719059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fe2d24a2-ee0b-48de-886a-cf864c695dc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.151741 Jul 19 15:39:14.719618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 447/878] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:15.474228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:39:15.474465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:39:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:39:15.735729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:15.736387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:15.743278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:15.743749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:15.744508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:15.744941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:15.874144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:15.881669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-56176b94-9d21-4f33-b543-a7dbc86a1ef0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.149750 Jul 19 15:39:15.882236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 432/879] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:16.900560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:16.901290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:16.907731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:16.908179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:16.908979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:16.909447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:17.037170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:17.045500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5a2d55cc-0529-42fd-bf4a-a2982b532fde tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.149696 Jul 19 15:39:17.046060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 448/880] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:17.984138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-0204e80c-5607-479a-aab5-4153db4cac0d req-03d003b4-2c97-4695-814a-57ee5132da97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "name": "network-vif-plugged", "status": "completed", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:17.995000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-0204e80c-5607-479a-aab5-4153db4cac0d req-03d003b4-2c97-4695-814a-57ee5132da97 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:17.995718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-0204e80c-5607-479a-aab5-4153db4cac0d req-03d003b4-2c97-4695-814a-57ee5132da97 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:18.006764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-0204e80c-5607-479a-aab5-4153db4cac0d req-03d003b4-2c97-4695-814a-57ee5132da97 service nova] Creating event network-vif-plugged:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:39:18.012308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-0204e80c-5607-479a-aab5-4153db4cac0d req-03d003b4-2c97-4695-814a-57ee5132da97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032132 Jul 19 15:39:18.012980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 433/881] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:18.063531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:18.064141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:18.071537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:18.071976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:18.072976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:18.073485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:18.270092 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:18.278157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-95ca093a-bf79-4950-bc20-e4936bd363ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.218631 Jul 19 15:39:18.278712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 449/882] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:39:19.296661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:19.297382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:19.303591 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:19.304039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:19.304805 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:19.305269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:19.437608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:19.444896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e4d2e609-2bf9-4805-845e-ccdc9b146ade tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.152975 Jul 19 15:39:19.445496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 434/883] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:20.461910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:20.462647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:20.469031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:20.469509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:20.470268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:20.470701 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:20.596511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:20.603795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f15e14c7-fa43-477e-a999-860d925873a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.145828 Jul 19 15:39:20.604335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 450/884] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:21.620503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:21.621166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:21.627667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:21.628119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:21.628889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:21.629359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:21.762077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:21.769761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2bc805bd-411c-4f0c-88f1-16617becb3f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1359 microversion: 2.1 time: 0.153123 Jul 19 15:39:21.770327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 435/885] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:22.786868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:22.787539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:22.794666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:22.795110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:22.795865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:22.796299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:22.922341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:22.929692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a3a9b6d7-73a0-4607-aeb2-7174b2bfb288 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1549 microversion: 2.1 time: 0.146728 Jul 19 15:39:22.930242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 451/886] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:22.946093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:22.946900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:22.953424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:22.953871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:22.954633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:22.955065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:23.082302 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:23.091041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d88b314b-8fb8-48a5-ad49-ff535820205c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1549 microversion: 2.1 time: 0.148724 Jul 19 15:39:23.091640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 436/887] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:23.106973 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:23.110400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:23.111172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Searching by: {'deleted': False, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc'} {{(pid=118006) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 15:39:23.117802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:23.118274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:23.119064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:23.119497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:23.205714 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.multi_cell_list [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118006) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 15:39:23.300030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cf4552f8-d9cd-4750-a3b4-1c8a9e8cc8af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.196799 Jul 19 15:39:23.300595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 452/888] 10.222.0.42 () {58 vars in 1124 bytes} [Tue Jul 19 15:39:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:23.310596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:23.311196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:23.317073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:23.317547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:23.318301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:23.318724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:23.449376 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:39:23.456775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a137c554-8cdb-4565-8841-5cb5efcf6376 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1549 microversion: 2.1 time: 0.149891 Jul 19 15:39:23.457363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 437/889] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:39:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:26.006705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "535b4dd5-a3e3-4840-bfb3-021d5b5c2374"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:39:26.007764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:39:26.015455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:26.015905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:26.016667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:39:26.017102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:39:26.256809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39b88adf-1958-444a-8728-4e134cfea782 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253833 Jul 19 15:39:26.257483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 453/890] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Jul 19 15:39:26 2022] POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:40:14.897022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:14.897659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:14.900432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:14.901072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=84 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:14.907230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:14.907677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:14.908441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:14.908875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:15.198375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:15.206250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c953be2d-6cbd-4cce-8bca-fc742ffac8b5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1595 microversion: 2.1 time: 0.312994 Jul 19 15:40:15.206819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 438/891] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1595 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:17.131015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-7a3c5c70-e17f-4409-a0da-d499bb92753a req-cf7ad566-9466-4d75-8994-d7208287833d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:40:17.136370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell0:SELECT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:17.137364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:17.138188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:17.144232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7a3c5c70-e17f-4409-a0da-d499bb92753a req-cf7ad566-9466-4d75-8994-d7208287833d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:17.145129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7a3c5c70-e17f-4409-a0da-d499bb92753a req-cf7ad566-9466-4d75-8994-d7208287833d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:17.160697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-7a3c5c70-e17f-4409-a0da-d499bb92753a req-cf7ad566-9466-4d75-8994-d7208287833d service nova] Creating event network-changed:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:40:17.166547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-7a3c5c70-e17f-4409-a0da-d499bb92753a req-cf7ad566-9466-4d75-8994-d7208287833d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039620 Jul 19 15:40:17.167536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 454/892] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:40:18.122450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-901867185"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:40:18.123000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:18.129758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:18.130519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:18.131305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:18.131744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:18.269893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.network.security_group_api [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Adding security group c900d57a-8b48-4abb-9ded-e739bdc7df4d to port aeb27489-0829-4e36-8f5c-a718f63aa2a0 Jul 19 15:40:18.606303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-38fa8ffc-8d98-4d2a-9a9f-fac1a25a86ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.487743 Jul 19 15:40:18.606906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 439/893] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:40:18 2022] POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:40:18.618142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:18.618854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:18.634939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:18.635454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:18.636445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:18.636897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:18.860239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:18.868996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6d4127ca-ea77-48bb-b3cb-f47c23dc802a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1759 microversion: 2.1 time: 0.257640 Jul 19 15:40:18.869522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 455/894] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1759 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:19.185008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-71347515-a40f-409a-9447-bf0156242718 req-f65d6c72-998c-4d85-8216-2854a4f8467e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:40:19.193433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-71347515-a40f-409a-9447-bf0156242718 req-f65d6c72-998c-4d85-8216-2854a4f8467e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:19.193875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-71347515-a40f-409a-9447-bf0156242718 req-f65d6c72-998c-4d85-8216-2854a4f8467e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:19.206033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-71347515-a40f-409a-9447-bf0156242718 req-f65d6c72-998c-4d85-8216-2854a4f8467e service nova] Creating event network-changed:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:40:19.211577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-71347515-a40f-409a-9447-bf0156242718 req-f65d6c72-998c-4d85-8216-2854a4f8467e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Jul 19 15:40:19.211815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 440/895] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:40:20.032035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:40:20.032979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:20.039399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:20.039891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:20.040654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:20.041086 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:20.110167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-37605585-f0ac-4099-9214-7b2f3746b922 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.081738 Jul 19 15:40:20.113189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 456/896] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:40:20 2022] POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:40:20.119681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:20.120455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:20.126951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:20.127398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:20.128207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:20.128632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:20.364258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:20.372959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3baac02a-d718-491b-931e-5178a710a0a8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1751 microversion: 2.1 time: 0.257467 Jul 19 15:40:20.373564 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 441/897] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:21.391670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:21.392271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:21.398914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:21.399554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:21.400138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:21.400568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:21.549010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:21.556888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e657870e-7dc6-4c05-8772-c7c5d570193a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.170329 Jul 19 15:40:21.557470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 457/898] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:22.574761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:22.575266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:22.581705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:22.582147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:22.582900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:22.583328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:22.722645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:22.731326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e0acf246-de19-4a52-bd5e-0b40562e3776 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.160531 Jul 19 15:40:22.731884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 442/899] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:23.748649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:23.749283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:23.755675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:23.756118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:23.756881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:23.757350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:23.899956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:23.907975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bb1fa750-4fcb-4014-b5d0-bc0824eaca88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163221 Jul 19 15:40:23.908571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 458/900] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:24.925984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:24.926593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:24.933988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:24.934433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:24.935198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:24.935633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:25.077750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:25.085836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f6dd14f7-0a5f-4965-8e8b-9c4b36564d55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163719 Jul 19 15:40:25.086447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 443/901] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:26.103519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:26.104151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:26.110591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:26.111070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:26.111875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:26.112307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:26.260045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:26.268333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-06687c56-1036-4e78-820d-193b00f74196 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.168621 Jul 19 15:40:26.268896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 459/902] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:27.286521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:27.287143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:27.294335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:27.294783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:27.295550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:27.295982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:27.437304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:27.445184 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e9b06995-5b91-4bee-9fc3-1a64df757556 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.162554 Jul 19 15:40:27.446890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 444/903] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:28.463639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:28.464173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:28.470763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:28.471209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:28.471997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:28.472425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:28.612647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:28.620659 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-99804d2e-f15d-48f6-b479-69f022c46426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.161011 Jul 19 15:40:28.621237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 460/904] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:29.638139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:29.638758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:29.645565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:29.646059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:29.646903 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:29.647390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:29.789906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:29.797889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-50d7befb-2977-40d1-af4e-586a6e38bed5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.164879 Jul 19 15:40:29.798456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 445/905] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:30.815862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:30.816476 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:30.823744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:30.824203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:30.824978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:30.825450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:30.967426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:30.975361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8b6e98bc-6527-4bd3-9bf9-30a10487385e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163404 Jul 19 15:40:30.975922 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 461/906] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:31.992953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:31.993587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:32.000055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:32.000512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:32.001311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:32.001753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:32.144386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:32.152858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2fab37ef-ea41-4332-b899-c37eb77f6e30 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163864 Jul 19 15:40:32.153460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 446/907] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:33.170982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:33.171508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:33.177939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:33.178387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:33.179142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:33.179618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:33.322795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:33.330745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-723071f0-92a4-4616-b052-ecfd5b35268d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163672 Jul 19 15:40:33.331334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 462/908] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:34.347980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:34.348598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:34.355809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:34.356260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:34.357027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:34.357491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:34.497126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:34.505224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3e7b80e1-4970-4375-8206-7ad2423a7534 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.161045 Jul 19 15:40:34.505795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 447/909] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:35.521728 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:35.522259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:35.528838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:35.529455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:35.530084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:35.530511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:35.675788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:35.684208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b440f08e-1643-4dd3-815d-006e61432c5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.166412 Jul 19 15:40:35.684769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 463/910] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:36.701956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:36.702555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:36.709170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:36.709634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:36.710427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:36.711488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:36.850975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:36.859390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f34ff591-90d7-460a-8182-786200af53e9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.161314 Jul 19 15:40:36.859953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 448/911] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:37.877353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:37.877958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:37.884440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:37.884900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:37.885660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:37.886089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:38.028184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:38.036073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-47a20fd9-138f-4d61-a676-07d72decca35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.162592 Jul 19 15:40:38.036632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 464/912] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:39.053489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:39.054098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:39.061328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:39.061781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:39.062550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:39.062999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:39.203521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:39.212200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b6060efa-45b3-498b-bd04-afc812a127f5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.162610 Jul 19 15:40:39.212768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 449/913] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:40.230116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:40.230718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:40.236786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:40.237259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:40.238026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:40.238454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:40.381528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:40.389531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e947ee64-dfc3-493a-b062-3f3d4dd5a64b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.164123 Jul 19 15:40:40.390344 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 465/914] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:41.407316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:41.407891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:41.414560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:41.415017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:41.415785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:41.416220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:41.560827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:41.568706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6480384f-9a19-4bf1-8e59-dfe5e4c680c2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.165460 Jul 19 15:40:41.569284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 450/915] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:42.586809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:42.587522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:42.593971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:42.594412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:42.595171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:42.595598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:42.736250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:42.744420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a18c2276-b174-45b5-80a1-e59963a6fa8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.162107 Jul 19 15:40:42.744984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 466/916] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:43.761388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:43.762182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:43.768513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:43.768955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:43.769736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:43.770164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:43.912697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:43.921200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ebdb3476-2a84-4763-aead-8c23d25c4431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.164193 Jul 19 15:40:43.921758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 451/917] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:44.938710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:44.939260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:44.946242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:44.946691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:44.947462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:44.947892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:45.090221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:45.098455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b6e8917a-f56b-472a-855d-1aaa4a566985 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.163685 Jul 19 15:40:45.099018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 467/918] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:46.116219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:46.116821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:46.123798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=29 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:46.125588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:46.126046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:46.126822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:46.127253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:46.131806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=79 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:46.284282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:46.292947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e267ea2d-42cd-408a-97f3-c55b03f005f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1756 microversion: 2.1 time: 0.180670 Jul 19 15:40:46.293548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 452/919] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:40:47.310128 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:40:47.310733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:40:47.317115 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:47.317586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:47.318340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:40:47.318772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:40:47.462224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:40:47.470207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3cf8458d-0d17-480c-9656-e65e35e9cc7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1759 microversion: 2.1 time: 0.163936 Jul 19 15:40:47.470774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 468/920] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:40:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:41:19.124292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-901867185"}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:41:19.124905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:19.126846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:19.127590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=5 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:19.134349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:19.134799 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:19.136081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:19.136519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:19.263027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.network.security_group_api [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Removing security group c900d57a-8b48-4abb-9ded-e739bdc7df4d from port aeb27489-0829-4e36-8f5c-a718f63aa2a0 Jul 19 15:41:19.591653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4ffe4fbf-89eb-4764-8694-b710a6bf01a3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action" status: 202 len: 0 microversion: 2.1 time: 0.471497 Jul 19 15:41:19.592669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 453/921] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:41:19 2022] POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:41:19.608819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:19.612241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:19.704441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-80a8c043-fc19-4f0a-9b37-5426331d3259 req-194a287e-454e-48a6-939e-122b813b4855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:41:19.713831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-80a8c043-fc19-4f0a-9b37-5426331d3259 req-194a287e-454e-48a6-939e-122b813b4855 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:19.714648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-80a8c043-fc19-4f0a-9b37-5426331d3259 req-194a287e-454e-48a6-939e-122b813b4855 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:19.728885 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-80a8c043-fc19-4f0a-9b37-5426331d3259 req-194a287e-454e-48a6-939e-122b813b4855 service nova] Creating event network-changed:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:41:19.735972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-80a8c043-fc19-4f0a-9b37-5426331d3259 req-194a287e-454e-48a6-939e-122b813b4855 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131915 Jul 19 15:41:19.740240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 469/922] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:21.272734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:21.273289 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:21.279310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:21.279754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:21.280528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:21.280944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:21.361831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lazy-loading 'services' on Instance uuid 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:41:21.435701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0cc613b9-e19a-4e46-8630-b6c23cad40b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments/535b4dd5-a3e3-4840-bfb3-021d5b5c2374" status: 202 len: 0 microversion: 2.1 time: 0.167294 Jul 19 15:41:21.436524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 454/923] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:41:21 2022] DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments/535b4dd5-a3e3-4840-bfb3-021d5b5c2374 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:41:21.446228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:21.447249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:21.454449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:21.454974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:21.455914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:21.456353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:21.487745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f2da4465-1884-41e1-ab3f-b7bf70dbe663 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Jul 19 15:41:21.488233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 470/924] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:21.751541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-ac660e21-a62a-4fd5-af16-3bf1daa6345d req-45062e06-632f-4f33-afb0-58174de7be36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:41:21.759743 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ac660e21-a62a-4fd5-af16-3bf1daa6345d req-45062e06-632f-4f33-afb0-58174de7be36 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:21.760178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-ac660e21-a62a-4fd5-af16-3bf1daa6345d req-45062e06-632f-4f33-afb0-58174de7be36 service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:21.771881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-ac660e21-a62a-4fd5-af16-3bf1daa6345d req-45062e06-632f-4f33-afb0-58174de7be36 service nova] Creating event network-changed:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:41:21.776928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-ac660e21-a62a-4fd5-af16-3bf1daa6345d req-45062e06-632f-4f33-afb0-58174de7be36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029222 Jul 19 15:41:21.777536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 455/925] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:22.501065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:22.502050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:22.508516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:22.508970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:22.509780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:22.510223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:22.538649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a2e2e917-a17f-489f-935b-76a5f0be21a2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 Jul 19 15:41:22.539194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 471/926] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:23.551885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:23.552812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:23.559594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:23.560039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:23.560792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:23.561248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:23.589236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5dc5d823-8a11-4c0b-ae70-ad3c5bdda55c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041368 Jul 19 15:41:23.589807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 456/927] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:24.600767 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:24.601717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:24.608954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:24.609467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:24.610223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:24.610652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:24.639278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1ee2887c-1eef-400b-8601-bd088ba311aa tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042399 Jul 19 15:41:24.639837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 472/928] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:25.650976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:25.652014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:25.658632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:25.659082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:25.659857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:25.660293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:25.689474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1b15f010-f70c-4e84-a916-5be6c363060b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 Jul 19 15:41:25.690030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 457/929] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:26.701435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:26.702375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:26.708699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:26.709161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:26.709929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:26.710357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:26.739583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f34a6645-1673-418b-a0c7-96e9d5e60038 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 Jul 19 15:41:26.740132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 473/930] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:27.751065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:27.751972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:27.758412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:27.758854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:27.759601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:27.760024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:27.788267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3ed07357-1c16-4dce-a1f0-5daf1663f7da tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041065 Jul 19 15:41:27.788797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 458/931] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:28.799563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:28.800815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:28.808063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:28.808569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:28.809684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:28.810120 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:28.839072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5684486b-13d3-414b-8217-9fc48fffaece tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043433 Jul 19 15:41:28.839614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 474/932] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:29.850653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:29.851667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:29.858934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:29.859379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:29.860141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:29.860568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:29.889371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-025d3cd0-830a-4edd-8a0a-724c60f1fc45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Jul 19 15:41:29.889916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 459/933] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:30.901234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:30.902168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:30.909681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:30.910293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:30.911270 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:30.911791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:30.940321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bdaefc21-dbfc-45ff-a6c3-fabb14d97c31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043189 Jul 19 15:41:30.940852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 475/934] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:31.952402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:31.953354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:31.960015 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:31.960471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:31.961271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:31.961712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:31.991639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9f4cf0f5-7738-4515-9881-0b87b2019c82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Jul 19 15:41:31.992193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 460/935] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:33.003341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:33.004449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:33.011068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:33.011512 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:33.012269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:33.012699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:33.041258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0ad16e1e-d3f3-4e49-9ba7-8bba8c56b4b0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041859 Jul 19 15:41:33.042628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 476/936] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:34.053504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:34.054416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:34.061554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:34.061998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:34.062758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:34.063186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:34.091187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d35f75b7-594a-4c16-b266-6bef97789e8e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 Jul 19 15:41:34.091721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 461/937] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:35.103043 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:35.104010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:35.110473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:35.110914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:35.111670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:35.112098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:35.139979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-04b9e07d-1be9-4bb8-bab2-113047390704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Jul 19 15:41:35.140511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 477/938] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:36.151778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:36.152725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:36.159187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:36.159627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:36.160393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:36.160829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:36.189919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3f28a24d-0828-49be-89ef-529db215ec38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042029 Jul 19 15:41:36.190389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 462/939] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:37.202093 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:37.203014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:37.209439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:37.209886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:37.210639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:37.211063 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:37.240012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d7d5db89-0291-4ae9-b20f-d3e3379c2ba3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 Jul 19 15:41:37.240565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 478/940] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:38.252221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:38.253151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:38.259601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:38.260052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:38.260819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:38.261280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:38.289739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f83cf374-900f-42d3-9686-189471c9748a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 Jul 19 15:41:38.290281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 463/941] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:39.302150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:39.303068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:39.310185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:39.310635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:39.311402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:39.311835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:39.340513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8a70d9cb-21c2-4638-b6e3-1d9e6b362db6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Jul 19 15:41:39.341064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 479/942] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:40.352027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:40.352943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:40.360013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:40.360441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:40.361225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:40.361656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:40.390228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-00e8a238-f187-4f88-b081-57f9a60560bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 Jul 19 15:41:40.390770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 464/943] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:41.401990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:41.402897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:41.409455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:41.409896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:41.410653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:41.411079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:41.439397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bb02a98b-b055-48a1-871c-a02c1a7ad628 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041300 Jul 19 15:41:41.439957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 480/944] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:42.451994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:42.452915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:42.459082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:42.459532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:42.460290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:42.460722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:42.489305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4b797c5d-93e5-433b-8f8c-d6ab048ce147 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041799 Jul 19 15:41:42.489852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 465/945] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:43.501000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:43.501943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:43.508521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:43.508911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:43.509727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:43.510225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:43.540036 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c21b5568-e65d-4109-9f88-5564700415ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043095 Jul 19 15:41:43.540589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 481/946] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:41:44.551106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:44.552045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:44.559754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:44.560201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:44.560953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:44.561480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:44.590817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4af1eb41-734c-4c61-a211-964c37a6357f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Jul 19 15:41:44.591383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 466/947] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:45.602528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:45.603447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:45.610294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:45.610750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:45.611517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:45.611952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:45.640427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a1e4e656-01b5-4cd1-8d3f-bf784637aa94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Jul 19 15:41:45.640965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 482/948] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:46.652726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:46.653660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:46.660033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:46.660473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:46.661259 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:46.661686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:46.689476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0787198-5acc-49c7-9a8e-49fedec48df9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 Jul 19 15:41:46.690011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 467/949] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:47.700994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:47.701969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:47.708460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:47.708906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:47.709724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:47.710157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:47.738687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8e700a3c-d27b-4e3a-9c5f-e1fbef2835e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 Jul 19 15:41:47.739229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 483/950] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:48.751053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:48.751992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:48.758433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:48.758878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:48.759632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:48.760056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:48.788959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d7637105-a7cc-457c-8538-e39058b619c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Jul 19 15:41:48.789535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 468/951] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:49.800720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:49.801675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:49.804073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=31 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:49.809768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:49.810216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:49.810984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:49.811415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:49.814966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=87 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:49.840191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8f3307d8-6e99-4389-9994-40a39225b16d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 Jul 19 15:41:49.840732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 484/952] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:50.851882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:50.852732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:50.855889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=33 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:50.861086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:50.861553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:50.862315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:50.862743 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:50.866428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:50.892027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f5bea79f-f77d-4161-b425-59cc16a8c71a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Jul 19 15:41:50.892580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 469/953] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:51.904096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:51.904953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:51.911452 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:51.911898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:51.912654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:51.913084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:51.941028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-730b2570-813a-44e5-9280-7fdbf20afbd6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041064 Jul 19 15:41:51.941607 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 485/954] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:52.952658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:52.953533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:52.960019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:52.960462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:52.961254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:52.961684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:52.991864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0958f787-51ed-480f-920a-9201f4344afe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Jul 19 15:41:52.992423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 470/955] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:54.003980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:54.004890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:54.011284 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:54.011730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:54.012743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:54.013202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:54.041605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4a47f687-5398-41de-a0d9-331f27c8167d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Jul 19 15:41:54.042146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 486/956] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:55.053202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:55.054130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:55.061198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:55.061645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:55.062407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:55.062839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:55.090997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-60e7c85b-aef8-4a58-a7cd-7ae8a0ca6bef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041218 Jul 19 15:41:55.091726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 471/957] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:56.103084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:56.104002 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:56.111438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:56.111889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:56.112655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:56.113089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:56.141170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bcbf341a-5527-4b0e-96d7-353777ed8169 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042057 Jul 19 15:41:56.141972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 487/958] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:57.153047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:57.153983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:57.160578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:57.161022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:57.161814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:57.162242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:57.191082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-efb20c46-f849-4517-998f-78bcc60c5c40 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Jul 19 15:41:57.191629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 472/959] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:58.202857 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:58.204732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:58.211502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:58.213293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:58.213293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:58.213733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:58.250600 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fcc098b7-7177-403d-86e1-c6669323cbe2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051744 Jul 19 15:41:58.251136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 488/960] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:41:59.262861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:41:59.263784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:41:59.270512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:59.270962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:59.271736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:41:59.272161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:41:59.300638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-446d8694-a49d-4117-b24e-b4542bd9d6ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042398 Jul 19 15:41:59.301206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 473/961] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:41:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:00.312904 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:00.313835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:00.321020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:00.321501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:00.322259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:00.322694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:00.350883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-39ad6402-5a9f-43e5-8b84-26282d8e1acf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042566 Jul 19 15:42:00.351423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 489/962] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:01.362443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:01.363371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:01.369966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:01.370419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:01.371187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:01.372240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:01.401504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1642e0b6-72ee-4ab8-9d16-f2bfe7d70ec1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Jul 19 15:42:01.402062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 474/963] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:02.412930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:02.413878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:02.420735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:02.421206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:02.421965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:02.422394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:02.450913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c570bf25-297b-4892-b66d-bd0387057d77 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041897 Jul 19 15:42:02.451456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 490/964] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:03.462367 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:03.463304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:03.470353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:03.470783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:03.471544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:03.471973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:03.500797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5b4e1dbc-df5b-4393-b0b8-6e46ab69fe62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Jul 19 15:42:03.501377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 475/965] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:04.512416 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:04.513281 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:04.519958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:04.520400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:04.521179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:04.521611 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:04.550013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c767bfb6-8737-403f-935e-c5d6f405cb09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Jul 19 15:42:04.550629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 491/966] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:05.561964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:05.562872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:05.569279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:05.569721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:05.570481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:05.570910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:05.600908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cc8af5cb-15d2-4691-ba24-36c557ce708b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Jul 19 15:42:05.601485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 476/967] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:06.613306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:06.614131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:06.620518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:06.620963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:06.621845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:06.622271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:06.650041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0dba91ce-b947-41ec-95ba-a81f07f545f2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040861 Jul 19 15:42:06.650569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 492/968] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:07.662219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:07.663086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:07.670321 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:07.670768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:07.671536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:07.671971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:07.700403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2c36737e-060d-4a7b-a596-75dda0a55485 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042230 Jul 19 15:42:07.700947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 477/969] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:08.712075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:08.712909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:08.719330 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:08.719771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:08.720531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:08.720958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:08.749283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cd57db58-a5e1-42fe-89ce-a69fd8158182 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 Jul 19 15:42:08.749817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 493/970] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:09.759914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:09.760881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:09.768062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:09.768511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:09.769307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:09.769736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:09.797643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c04dfa38-87aa-4787-a6e3-2fcf39d14874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 Jul 19 15:42:09.798187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 478/971] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:10.809407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:10.810339 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:10.816337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:10.816788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:10.817582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:10.818128 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:10.846189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2b9db7f4-f9c9-4fe0-b9a8-255c0d6ce281 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041654 Jul 19 15:42:10.846727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 494/972] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:11.857781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:11.858723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:11.865303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:11.865750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:11.866545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:11.866976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:11.896254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4b129579-b6f8-42d2-986d-d8fcc7bce733 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042416 Jul 19 15:42:11.896798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 479/973] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:12.853406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:42:12.853635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:42:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:42:12.908431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:12.909375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:12.915878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:12.916319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:12.917075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:12.917526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:12.950651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-964cd4b3-1cfe-4cf4-9283-ecde2fe0c635 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Jul 19 15:42:12.951195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 495/974] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:13.596380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:42:13.596685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:42:13.962208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:13.963145 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:13.969957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:13.970400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:13.971153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:13.971581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:14.001219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-541e4eeb-b497-4c33-9f87-39f83ec2d79a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 Jul 19 15:42:14.001763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 480/975] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:42:15.012888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:15.013840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:15.020461 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:15.020903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:15.021698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:15.022127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:15.050573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb7c0ee9-3bcc-46a2-8d4f-b605060ada09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042311 Jul 19 15:42:15.051109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 496/976] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:16.063030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:16.063941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:16.070488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:16.070929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:16.071680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:16.072109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:16.101591 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bfc2d878-4443-48ee-b54a-7d7e4b653ae2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Jul 19 15:42:16.102140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 481/977] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:17.113426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:17.114340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:17.120746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:17.122289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:17.123066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:17.123503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:17.153775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-29ec672d-cabe-458e-b882-bc9a442144c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Jul 19 15:42:17.154322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 497/978] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:18.165541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:18.166437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:18.172976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:18.173457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:18.174209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:18.174634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:18.204801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-16c7f126-c605-48d9-90a6-bde7be5ad456 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jul 19 15:42:18.205754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 482/979] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:19.217176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:19.218127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:19.224549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:19.224994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:19.225814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:19.226227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:19.258247 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-697b0c02-7dd0-4070-acd9-83ad044c5527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Jul 19 15:42:19.258815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 498/980] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:20.270201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:20.271333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:20.277628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:20.278076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:20.278844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:20.279621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:20.307821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-68f445d7-3364-4e76-bbd1-801c26ec6239 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041813 Jul 19 15:42:20.308362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 483/981] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:21.319815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:21.320810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:21.323052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:21.328537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:21.328981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:21.329768 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:21.330196 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:21.332692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:21.359719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bc11aa73-88b8-4401-92ac-7c7298e59853 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 Jul 19 15:42:21.360261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 499/982] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:22.371332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:22.372238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:22.374926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:22.380306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:22.380746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:22.381532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:22.381964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:22.385674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:22.415293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9c03d935-4251-42bf-b68b-8b453a389e89 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Jul 19 15:42:22.415833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 484/983] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:23.427394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:23.428308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:23.435221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:23.435672 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:23.437348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:23.437788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:23.465603 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6f3f3955-e70b-4c61-b9cc-51ba5b28e1ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042074 Jul 19 15:42:23.466146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 500/984] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:24.477224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:24.478140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:24.484990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:24.485461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:24.486215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:24.486644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:24.516437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9cdd6fc6-6330-4e22-acb5-c7cd8b990527 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jul 19 15:42:24.517174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 485/985] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:25.528489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:25.529480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:25.537105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:25.537787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:25.538889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:25.539511 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:25.570162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ead8ad71-7a2e-4869-8c52-370f6173566c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Jul 19 15:42:25.570712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 501/986] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:26.582858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:26.583693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:26.590100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:26.590548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:26.591301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:26.591733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:26.619916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2ec1e2a1-a51f-4203-b50b-aab2f1b4d840 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041111 Jul 19 15:42:26.620451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 486/987] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:27.632017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:27.632876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:27.640142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:27.640587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:27.641374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:27.641804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:27.669079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e7f4633e-67c4-4e1e-9276-0fe7eea40569 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041098 Jul 19 15:42:27.669644 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 502/988] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:28.680554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:28.681513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:28.687838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:28.688281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:28.689035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:28.689485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:28.717334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eed562ff-b18b-4145-8573-6d2cd649b273 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040637 Jul 19 15:42:28.718474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 487/989] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:29.729424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:29.730329 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:29.737316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:29.737756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:29.738643 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:29.739072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:29.766745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-744c491d-9c3a-454f-8246-afbc44198b4f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041255 Jul 19 15:42:29.767487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 503/990] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:30.778511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:30.779345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:30.786452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:30.786897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:30.787655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:30.788093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:30.815885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5bd9e4f5-b2e8-499c-8ecf-3da3fa0a5817 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 Jul 19 15:42:30.816423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 488/991] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:31.827827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:31.828654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:31.835117 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:31.835558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:31.836310 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:31.836737 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:31.865022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-818f84a3-9468-4fa3-950b-7e79d88abc6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 Jul 19 15:42:31.865589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 504/992] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:32.876372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:32.877362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:32.883849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:32.884287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:32.885045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:32.885499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:32.914411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-11d6e636-376d-436c-84fc-2df84c2a4cdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041973 Jul 19 15:42:32.914952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 489/993] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:42:33.926680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:33.927621 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:33.934197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:33.934641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:33.935399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:33.935822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:33.963883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-64a49620-0ca6-4850-bd87-dfe18e14576f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041247 Jul 19 15:42:33.964421 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 505/994] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:34.975356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:34.976267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:34.982718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:34.983162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:34.983935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:34.984369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:35.012261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7d301d22-855b-4451-985c-bf17e2bf54b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040821 Jul 19 15:42:35.012800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 490/995] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:35.483453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:42:35.484447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:42:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:42:36.024496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:36.025531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:36.032709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:36.033164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:36.033929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:36.034359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:36.061836 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d9a76a1c-c2a1-4416-b158-dbb66d12a1b6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Jul 19 15:42:36.062461 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 506/996] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:37.073861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:37.074807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:37.081334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:37.081783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:37.082539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:37.082963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:37.112008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-11b6673c-5c66-4b24-8191-f4f1279f1120 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Jul 19 15:42:37.112547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 491/997] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:38.123793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:38.125558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:38.132030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:38.132479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:38.133282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:38.133720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:38.162954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ffcba28d-81e0-4900-bb5d-a717adfe9426 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043126 Jul 19 15:42:38.163507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 507/998] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:39.174845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:39.175669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:39.182250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:39.182698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:39.183461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:39.183890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:39.211819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-13a146e8-1a19-4fbd-b50b-7542dfb94fe5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041286 Jul 19 15:42:39.212364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 492/999] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:40.223924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:40.224870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:40.230862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:40.231311 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:40.232073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:40.232509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:40.262232 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3304b3fa-c0b0-4b1f-af99-ccaad2801597 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Jul 19 15:42:40.262785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 508/1000] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:41.274263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:41.275181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:41.282316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:41.282777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:41.283546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:41.283983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:41.312029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eeb9d1a0-b882-47c5-b607-de69a38645e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 Jul 19 15:42:41.312981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 493/1001] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:42.323977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:42.324933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:42.331502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:42.331954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:42.332722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:42.333180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:42.362468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a52cfc75-6624-4d72-89c7-5116a0604bea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jul 19 15:42:42.363010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 509/1002] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:43.374900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:43.375962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:43.382043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:43.382483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:43.383237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:43.383661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:43.412455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-83ba15f1-9b0f-4ec4-aa82-280de24bd66a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Jul 19 15:42:43.412996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 494/1003] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:44.423942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:44.424844 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:44.431475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:44.431913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:44.432666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:44.433090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:44.462009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c4408a09-f0f0-4360-b79d-847c9b57de35 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Jul 19 15:42:44.462549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 510/1004] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:45.473975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:45.474887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:45.481355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:45.481796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:45.482556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:45.482989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:45.511488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-084facec-b242-4db9-aa63-4c1eb5ccf367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041362 Jul 19 15:42:45.511963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 495/1005] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:46.523509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:46.524348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:46.531316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:46.531765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:46.532530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:46.532967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:46.560921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cafabc97-a7eb-418d-afb8-27bcd9911486 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 Jul 19 15:42:46.561484 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 511/1006] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:47.573071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:47.574013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:47.580411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:47.580975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:47.581786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:47.582215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:47.611255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-643da93c-439a-4199-a84a-e8f841c28616 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Jul 19 15:42:47.611795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 496/1007] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:48.622958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:48.623773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:48.630962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:48.631409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:48.632167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:48.632595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:48.661534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d0b221fc-1c32-450f-ad3b-8c1b6a3fce46 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 Jul 19 15:42:48.662394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 512/1008] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:49.677877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:49.678800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:49.685302 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:49.685751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:49.686521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:49.686960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:49.715895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ad263280-ea91-4096-ab3c-4f9930cf5d5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042125 Jul 19 15:42:49.716451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 497/1009] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:50.728604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:50.729545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:50.736797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:50.737270 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:50.738038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:50.738473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:50.766263 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b836c534-71e6-434a-807c-338a5b74e541 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041750 Jul 19 15:42:50.766804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 513/1010] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:51.778159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:51.779071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:51.786209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:51.786659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:51.787422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:51.787846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:51.816639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d7a3e015-48c2-4c09-b2b6-a16f5473ff74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Jul 19 15:42:51.817205 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 498/1011] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:52.828218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:52.829212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:52.831470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:52.836754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:52.837214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:52.837974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:52.838412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:52.842086 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:52.867435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d3d56de5-12b9-4c89-a773-a9dd5c089a54 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Jul 19 15:42:52.867969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 514/1012] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:53.878939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:53.879753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:53.882173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:53.887339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:53.887782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:53.888535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:53.888956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:53.893817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:53.917996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7c1a7729-04de-4db7-bf14-825348bd894c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Jul 19 15:42:53.918529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 499/1013] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:54.930240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:54.931152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:54.938218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:54.938663 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:54.939424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:54.939855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:54.968515 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-366a5402-4271-4de5-badf-b3712cb4dba2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041617 Jul 19 15:42:54.969109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 515/1014] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:55.979967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:55.980886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:55.987859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:55.988301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:55.989063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:55.989519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:56.019977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1dbd560c-be67-41a9-abf1-e3fc824f6176 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Jul 19 15:42:56.020518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 500/1015] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:57.032432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:57.033389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:57.039736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:57.040176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:57.040930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:57.041383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:57.068482 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7b5cd79e-7f8a-4976-82fb-73bf1336d582 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040693 Jul 19 15:42:57.069023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 516/1016] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:58.080275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:58.081220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:58.087692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:58.088169 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:58.088934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:58.089393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:58.118783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f80b61b-9307-415c-8f8f-d4b575f24ab4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Jul 19 15:42:58.119329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 501/1017] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:42:59.131168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:42:59.132151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:42:59.138629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:59.139084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:59.140545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:42:59.140985 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:42:59.169351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5b82be14-10fc-4d80-a9b9-34bec4ed5a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042196 Jul 19 15:42:59.169903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 517/1018] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:42:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:00.181616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:00.182520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:00.188970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:00.189437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:00.190188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:00.190614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:00.219315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6acaf399-b878-4249-a2af-bdd48d9a45e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 Jul 19 15:43:00.219858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 502/1019] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:01.230992 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:01.231904 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:01.239134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:01.239583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:01.240359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:01.240784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:01.269677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-75a42a38-2979-4f0f-9e02-44214a319202 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jul 19 15:43:01.270231 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 518/1020] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:02.281701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:02.282684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:02.289117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:02.289588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:02.290352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:02.290784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:02.320713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-14292617-3bdb-461e-b3e3-87c8859f0d0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 Jul 19 15:43:02.321275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 503/1021] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:03.333112 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:03.334084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:03.340456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:03.340904 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:03.341770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:03.342205 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:03.369987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21c4f73f-79a4-4a53-911e-2e77ec4f74f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040804 Jul 19 15:43:03.370530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 519/1022] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:04.381626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:04.382529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:04.389005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:04.389476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:04.390911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:04.391336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:04.420297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a2bc5445-0e65-4b96-9b90-eb06f13ac02a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jul 19 15:43:04.420867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 504/1023] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:05.431848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:05.432765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:05.440021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:05.440471 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:05.441274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:05.441715 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:05.471897 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cced5bbe-ef6c-4755-ba61-23856db1f5d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043901 Jul 19 15:43:05.472441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 520/1024] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:06.483579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:06.484529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:06.491021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:06.491466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:06.492223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:06.492653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:06.521945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-69c14f86-d901-4364-bef8-d362a307e0df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jul 19 15:43:06.522414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 505/1025] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:07.534582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:07.535432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:07.542831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:07.543280 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:07.544045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:07.544479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:07.573014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-09303c5f-0db4-4356-b242-7a383d633a88 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Jul 19 15:43:07.573586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 521/1026] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:08.584318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:08.585262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:08.591729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:08.592295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:08.593431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:08.593877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:08.621688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c8bc0d92-ba20-48d1-910a-706d494d9029 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 Jul 19 15:43:08.622226 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 506/1027] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:09.634176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:09.635131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:09.642047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:09.642755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:09.643527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:09.643960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:09.673410 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-84b8639d-0b6a-40e7-bed6-c69e01fd4510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jul 19 15:43:09.673972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 522/1028] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:10.685157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:10.686221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:10.693489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:10.693943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:10.694713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:10.695149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:10.723031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-451d5fe1-60c9-4a74-83b4-2d3171699a9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 Jul 19 15:43:10.723583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 507/1029] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:11.735097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:11.736045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:11.742575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:11.743029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:11.743797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:11.744234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:11.773351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e280a999-2a3f-4bdb-96c4-184b0a5d9b57 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 Jul 19 15:43:11.773892 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 523/1030] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:12.785249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:12.786168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:12.792293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:12.792739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:12.793534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:12.793966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:12.821541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-54e62ee0-2ddb-4d4e-91aa-2c1795d5a890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040332 Jul 19 15:43:12.822072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 508/1031] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:13.832969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:13.833943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:13.840349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:13.840791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:13.841583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:13.842017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:13.870817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5f582e18-4cd2-42c2-970e-24b8ea363578 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 Jul 19 15:43:13.871355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 524/1032] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:14.881840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:14.882749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:14.889310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:14.890316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:14.891066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:14.891494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:14.919795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2c3b3482-2bdd-451a-8595-66e739140080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Jul 19 15:43:14.920267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 509/1033] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:15.931455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:15.932289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:15.939220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:15.939664 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:15.940417 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:15.940845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:15.970235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e207aa18-4e8e-4345-823d-34cf6e7868e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Jul 19 15:43:15.970784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 525/1034] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:16.981774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:16.982619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:16.990261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:16.990727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:16.991472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:16.991905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:17.172833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-84a3baa4-ad25-4b6f-9ec7-24d69f202245 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195024 Jul 19 15:43:17.173413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 510/1035] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:18.184463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:18.185315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:18.191777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:18.192218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:18.192970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:18.193419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:18.223677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-63f496d1-0d30-4fa4-8879-1b752636dac3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Jul 19 15:43:18.224636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 526/1036] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:19.236304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:19.237230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:19.243983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:19.244430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:19.245255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:19.245689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:19.274272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3d827cf1-d1e4-4718-b4d9-b77e28a1058a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Jul 19 15:43:19.274807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 511/1037] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:20.286122 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:20.287049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:20.293554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:20.294011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:20.294776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:20.295214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:20.331290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b2720f0e-4f51-483a-ba20-4714f53d0b04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Jul 19 15:43:20.331867 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 527/1038] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:21.343333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:21.344262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:21.352040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:21.352405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:21.353205 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:21.353636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:21.383434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-afeab873-0ccf-4dcb-8a50-b21d0211c6f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Jul 19 15:43:21.383981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 512/1039] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:22.395283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:22.396195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:22.402623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:22.403068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:22.403822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:22.404250 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:22.432584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cf6e00d3-93e8-4785-9c16-e142e532dde6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041515 Jul 19 15:43:22.433129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 528/1040] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:23.444119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:23.445027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:23.451516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:23.451963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:23.452723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:23.453730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:23.481448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-78ee2ad3-eb8c-4f21-af6e-bf9a7c590aca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 Jul 19 15:43:23.481987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 513/1041] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:24.493191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:24.494114 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:24.496377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:24.502550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:24.503004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:24.503831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:24.504222 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:24.507780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:24.533105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6af4e547-fb80-4b2e-af9a-2e72bfd1a5e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Jul 19 15:43:24.533672 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 529/1042] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:25.544182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:25.545419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:25.548605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:25.552380 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:25.552806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:25.553610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:25.554046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:25.558252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:25.583287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-98d33e7f-8833-4316-8f1e-f8e64c3c0890 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 Jul 19 15:43:25.583825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 514/1043] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:26.595167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:26.595994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:26.602474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:26.602918 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:26.603670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:26.604098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:26.632312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21fdd8fc-91c8-4b7d-a468-6395078d9d24 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041722 Jul 19 15:43:26.632851 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 530/1044] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:27.644490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:27.645439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:27.652084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:27.652534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:27.653344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:27.653804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:27.682486 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c27e8410-85d7-4658-b5f8-1231d5717f4a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042559 Jul 19 15:43:27.683021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 515/1045] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:28.694180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:28.695020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:28.701463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:28.701905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:28.702658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:28.703619 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:28.731501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ad1949ba-645c-4ee4-9573-4268f672fa64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Jul 19 15:43:28.732037 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 531/1046] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:29.743314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:29.744241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:29.750753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:29.751204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:29.751975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:29.752410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:29.782505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-17eca6b1-b74f-4040-9e7a-3ac8f187f03d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Jul 19 15:43:29.783040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 516/1047] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:30.794197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:30.795116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:30.802023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:30.802468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:30.803228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:30.803660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:30.832324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f12b6f7a-caff-448b-b9de-62cbe3a1b063 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042049 Jul 19 15:43:30.832863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 532/1048] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:31.843730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:31.844630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:31.851015 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:31.851460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:31.852213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:31.852641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:31.880427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e1d707fc-34e4-4c73-a3c6-930224f559d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040709 Jul 19 15:43:31.880965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 517/1049] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:32.893072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:32.894013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:32.900434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:32.900883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:32.901678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:32.902113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:32.930312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1a7c6972-8863-40a4-a8d7-66e571b604ac tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042280 Jul 19 15:43:32.930849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 533/1050] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:33.942637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:33.943556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:33.949899 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:33.950343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:33.951097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:33.951523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:33.979868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d460c540-21f3-492e-8956-40250419766f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 Jul 19 15:43:33.980401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 518/1051] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:34.991178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:34.992127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:34.998573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:34.999021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:35.000290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:35.000817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:35.029823 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9880a67a-ef46-4575-b22f-813eec892f66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042767 Jul 19 15:43:35.030380 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 534/1052] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:36.041532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:36.042448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:36.049949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:36.050396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:36.051168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:36.051596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:36.080092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-10501b65-f054-41bc-afd6-355d59cb2009 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 Jul 19 15:43:36.080631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 519/1053] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:37.091773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:37.092729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:37.100157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:37.100610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:37.101441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:37.101883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:37.130043 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1d3c8983-60ac-46ee-8301-bbda497ec8d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 Jul 19 15:43:37.130586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 535/1054] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:38.142032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:38.143227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:38.149622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:38.150065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:38.150818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:38.151242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:38.178686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fd22f575-8227-4fef-9be7-04a52d3cae61 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 Jul 19 15:43:38.179214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 520/1055] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:39.191166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:39.192072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:39.198156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:39.198597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:39.199350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:39.199778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:39.228500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1f9f6089-8ba1-4d5c-b420-55cff5f4409b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 Jul 19 15:43:39.229039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 536/1056] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:40.239959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:40.240873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:40.247305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:40.247779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:40.248549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:40.248976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:40.278725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b29e62cf-1265-4d85-b31a-40868df343fe tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Jul 19 15:43:40.279265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 521/1057] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:41.290268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:41.291214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:41.298148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:41.298595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:41.299358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:41.299788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:41.328271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9a55267b-f49e-463b-a048-734cf75fc58c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041773 Jul 19 15:43:41.328915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 537/1058] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:42.339933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:42.340845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:42.347124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:42.347573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:42.348329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:42.348761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:42.376844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ceb601da-88d8-466b-a459-906bac05c2b2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040857 Jul 19 15:43:42.377424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 522/1059] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:43.388042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:43.388967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:43.395978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:43.396436 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:43.397219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:43.397661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:43.426783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3fe6e1c5-b6a4-480d-978b-3347de608490 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Jul 19 15:43:43.427326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 538/1060] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:44.438480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:44.439430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:44.445870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:44.446313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:44.447164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:44.447600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:44.476999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1879cfde-f12a-4211-bdb7-a53a926d196d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042638 Jul 19 15:43:44.477573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 523/1061] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:45.489487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:45.490400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:45.496798 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:45.497278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:45.498041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:45.498473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:45.527498 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-27d62456-9fc1-498b-8e68-80e2c1377e8f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042782 Jul 19 15:43:45.527972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 539/1062] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:46.539479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:46.540311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:46.546873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:46.547314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:46.548069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:46.548494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:46.576774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a7be9330-020a-43fc-9c24-1bffd638add6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041592 Jul 19 15:43:46.577331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 524/1063] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:47.588906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:47.589850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:47.596363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:47.596802 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:47.597592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:47.598017 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:47.626791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d4e6bcce-44b2-4ac9-9da1-71f5c61726ed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 Jul 19 15:43:47.627338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 540/1064] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:48.638788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:48.639629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:48.646478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:48.646928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:48.647699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:48.648131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:48.678163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-db2845af-79d4-4f58-bc0b-da231fa4b0c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043419 Jul 19 15:43:48.678710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 525/1065] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:49.741584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:49.742793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:49.748777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:49.749264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:49.750035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:49.750470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:49.781261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5a55a77d-6df5-40b9-8fb2-539210184892 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095384 Jul 19 15:43:49.781816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 541/1066] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:50.793333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:50.794265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:50.804536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:50.805353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:50.806594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:50.807042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:50.837250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-614acfcd-067a-4f56-a991-956649234792 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Jul 19 15:43:50.837796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 526/1067] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:51.847772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:51.848733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:51.855294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:51.855745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:51.856517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:51.856954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:51.885986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9b5cc371-af74-40ca-89f2-e2bb1e2c1ceb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 Jul 19 15:43:51.886549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 542/1068] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:52.897839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:52.898749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:52.905101 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:52.905573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:52.906321 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:52.906748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:52.934683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9d32d737-3ab7-41f7-afb5-d1326cdc9cc7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040709 Jul 19 15:43:52.935214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 527/1069] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:53.946700 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:53.947607 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:53.954040 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:53.954480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:53.955283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:53.955708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:53.984141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6e27f2e6-97dd-4096-975f-a1f55d27033f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Jul 19 15:43:53.984681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 543/1070] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:54.519155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:43:54.519707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:43:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:43:54.995798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:54.996738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:55.003984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:55.004423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:55.005200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:55.005628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:55.034249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-64423aad-c243-4c31-b05d-2f3dd0abb221 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042362 Jul 19 15:43:55.034784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 528/1071] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:56.044694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:56.045639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:56.047894 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:56.054206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:56.054653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:56.055469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:56.055896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:56.058297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:56.085039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4da308e3-5273-4d17-bb08-746a6f902363 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Jul 19 15:43:56.085609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 544/1072] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:57.095764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:57.096667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:57.099047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:57.104535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:57.104976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:57.105758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:57.106186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:57.108650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:57.135393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d92e3927-f510-4872-994f-578c854a62af tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043517 Jul 19 15:43:57.135927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 529/1073] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:58.146545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:58.147452 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:58.153954 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:58.154394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:58.155148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:58.155574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:58.184437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cee06c0e-5cc5-40c1-b71f-df1268e1ddab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042336 Jul 19 15:43:58.184972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 545/1074] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:59.195627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:59.196532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:43:59.203642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:59.204100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:59.204850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:59.205906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:59.233071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-203c91d1-4cf3-4165-a2bd-244149db9856 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041396 Jul 19 15:43:59.233629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 530/1075] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:43:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:00.244012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:00.244921 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:00.251434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:00.252609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:00.253524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:00.253957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:00.283765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0e5307e7-c4a7-485b-9f7c-589e203bca25 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Jul 19 15:44:00.284070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 546/1076] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:01.295234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:01.296094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:01.303203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:01.303644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:01.304403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:01.304832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:01.334702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-210fa5e5-fdb9-4a1e-a7cd-f7082f304402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043507 Jul 19 15:44:01.335249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 531/1077] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:02.347098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:02.347950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:02.354368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:02.354814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:02.355566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:02.355995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:02.384879 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c7d2003d-b3fe-440f-8063-7e306a0872ef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042357 Jul 19 15:44:02.385459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 547/1078] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:44:03.396629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:03.397502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:03.403906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:03.404357 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:03.405118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:03.405574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:03.435018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05361396-9eb8-469a-a604-3ace5f424ac6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Jul 19 15:44:03.435565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 532/1079] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:04.446910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:04.447803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:04.454255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:04.454705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:04.456065 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:04.456502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:04.483890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5f3c9955-900d-4de3-8f76-956c5afde741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041037 Jul 19 15:44:04.484428 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 548/1080] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:05.495296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:05.496206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:05.503404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:05.503846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:05.504596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:05.505023 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:05.532575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f612afd9-79d0-48d5-a877-bb471c5c3371 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041227 Jul 19 15:44:05.533163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 533/1081] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:06.544261 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:06.545196 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:06.551819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:06.552267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:06.553031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:06.553509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:06.582207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2af5f6eb-d070-43ce-8ccf-e273c8736f6a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Jul 19 15:44:06.582757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 549/1082] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:44:07.596579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:07.597538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:07.604315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:07.604817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:07.605628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:07.606066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:07.634906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9d8e6190-1448-45b0-93fa-6eae543ea132 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042363 Jul 19 15:44:07.635454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 534/1083] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:08.646888 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:08.647758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:08.657181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:08.657636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:08.659222 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:08.659666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:08.691426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7be74b48-716f-445a-ab11-e7bff7652379 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049182 Jul 19 15:44:08.692013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 550/1084] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:09.703926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:09.705485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:09.712815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:09.713302 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:09.714066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:09.714497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:09.744995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fef32357-98d8-48be-af65-c65ed2f78279 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Jul 19 15:44:09.745577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 535/1085] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:10.757646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:10.758562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:10.764967 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:10.765610 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:10.766630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:10.767107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:10.799162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0eb9c573-63bd-4e63-8c72-4d626dd0ddb9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Jul 19 15:44:10.799832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 551/1086] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:11.811729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:11.812802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:11.819984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:11.820424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:11.821262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:11.821694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:11.851612 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-63435c20-00bb-4983-9cf3-1e4571f814cd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Jul 19 15:44:11.852154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 536/1087] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:12.864126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:12.865096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:12.871538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:12.871982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:12.872739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:12.873187 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:12.901901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f1f781d6-2968-46ea-af20-f2f179141d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jul 19 15:44:12.902432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 552/1088] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:13.914307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:13.915218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:13.921192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:13.921643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:13.922401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:13.922835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:13.950667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-699a6ff0-59d8-4b7f-b8ee-8174283ca402 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 Jul 19 15:44:13.951196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 537/1089] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:14.961747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:14.962656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:14.969018 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:14.969492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:14.970773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:14.971209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:14.999015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-247ff1ac-5c0c-4402-b4ac-5aed5c4f8874 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041458 Jul 19 15:44:14.999540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 553/1090] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:16.011268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:16.012180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:16.018903 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:16.019352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:16.020104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:16.020534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:16.047891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a8b285e3-be00-4b1a-8a70-2c86797e04e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040628 Jul 19 15:44:16.048429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 538/1091] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:16.137333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:44:16.137489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:44:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:44:17.059929 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:17.060839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:17.067944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:17.068386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:17.069171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:17.069596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:17.097559 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7cc4df77-db30-49fe-b48f-5d01a8ea5a4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Jul 19 15:44:17.098096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 554/1092] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:18.109026 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:18.109979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:18.117312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:18.117765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:18.118530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:18.118964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:18.149432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-738e72aa-ea04-41da-9c9f-c532ed498f74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Jul 19 15:44:18.149996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 539/1093] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:19.160598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:19.161527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:19.168024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.168469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.169251 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.169680 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.198217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ce9d5f8c-3dff-472f-a8a0-85604a80318d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 Jul 19 15:44:19.198756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 555/1094] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:20.210623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:20.211541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:20.218052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:20.218505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:20.219266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:20.219700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:20.247436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-019f97a6-1eb4-4420-b655-f47987fae0bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Jul 19 15:44:20.247986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 540/1095] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:20.992604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:44:20.993170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:44:21.259076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:21.260015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:21.266518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:21.266956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:21.267716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:21.268902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:21.297353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-697ee735-b98d-404b-ae24-7c1832aa7fae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042236 Jul 19 15:44:21.297896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 556/1096] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:22.308961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:22.309922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:22.316773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:22.317248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:22.318012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:22.318440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:22.347241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f9cc3a7d-a7e5-4208-803e-95cd28762839 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041622 Jul 19 15:44:22.347817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 541/1097] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:23.359006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:23.359930 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:23.366549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:23.367003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:23.367773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:23.368210 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:23.404683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7a171ab8-122e-4380-aa32-a3dc453efaa7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049689 Jul 19 15:44:23.405266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 557/1098] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:24.416608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:24.417553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:24.424036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:24.424486 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:24.425282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:24.425751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:24.453163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-541a9c62-5a11-4048-8a84-1250406fbe18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040532 Jul 19 15:44:24.453697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 542/1099] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:44:25.465287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:25.466190 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:25.472751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:25.473224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:25.473981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:25.474405 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:25.501514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-949c84dd-9511-4995-9a15-87f2b1c8aa7a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040155 Jul 19 15:44:25.502054 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 558/1100] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:26.513694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:26.514536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:26.521756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:26.522206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:26.522964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:26.523396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:26.552219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a4d0e2b6-359c-409a-ad70-6a39cf57d604 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Jul 19 15:44:26.552756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 543/1101] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:44:27.563684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:27.564534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:27.566902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:27.572281 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:27.572723 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:27.573509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:27.573937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:27.577676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:27.603450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dcf48864-9278-4a96-a7cf-8248bfc49018 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Jul 19 15:44:27.604000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 559/1102] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:28.615162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:28.616000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:28.618440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:28.623717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:28.624169 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:28.624929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:28.625397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:28.628575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:28.655340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-216effb2-0cae-4042-a5b1-d7fa090cbe86 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Jul 19 15:44:28.655878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 544/1103] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:29.666435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:29.667351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:29.673827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:29.674271 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:29.675602 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:29.676038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:29.703630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-43bcfddb-59c6-4ba0-a849-9329fad2c5a7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Jul 19 15:44:29.704171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 560/1104] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:30.716599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:30.717476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:30.724796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:30.725279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:30.726047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:30.726482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:30.754942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a6bdfaa5-1da9-4916-94d7-08d51db371c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042370 Jul 19 15:44:30.755489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 545/1105] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:31.765717 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:31.766666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:31.773604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:31.774054 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:31.774818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:31.775251 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:31.809617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b1ce9c5a-6a98-4be3-87f5-a796e7a70367 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Jul 19 15:44:31.810166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 561/1106] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:32.821005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:32.821945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:32.828408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:32.828851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:32.829648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:32.830078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:32.858345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a5e57451-28ad-4635-b36a-1f6e1efdb502 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041285 Jul 19 15:44:32.858891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 546/1107] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:33.869801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:33.870714 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:33.877255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:33.877743 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:33.878763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:33.879208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:33.907840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3e5f4006-2a67-42e6-8f6e-beaa1d559810 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042332 Jul 19 15:44:33.908377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 562/1108] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:34.920312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:34.921156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:34.928268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:34.928710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:34.929498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:34.929927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:34.958308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3e2594d7-8476-49f0-8fe1-1344e703f81a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 Jul 19 15:44:34.958855 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 547/1109] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:35.969626 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:35.970555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:35.977164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:35.977616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:35.978378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:35.978810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:36.007535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-04ddb581-c654-4048-bd4c-23d4833012ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041834 Jul 19 15:44:36.008074 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 563/1110] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:44:37.019984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:37.020905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:37.027348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:37.027795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:37.028561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:37.029000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:37.058295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fd341e88-7c00-4f60-b029-088e32f5ffd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Jul 19 15:44:37.058837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 548/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:38.070200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:38.071113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:38.077508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:38.077952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:38.078709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:38.079136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:38.107357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5194165b-2569-4c05-b0c5-925b2bc774ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041139 Jul 19 15:44:38.107899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 564/1112] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:39.119001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:39.119907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:39.126379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:39.126823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:39.127666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:39.128095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:39.155873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4af80440-0b24-4c73-a1a8-9f1895a92016 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040886 Jul 19 15:44:39.156405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 549/1113] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:40.167492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:40.168397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:40.174622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:40.175062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:40.175820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:40.176248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:40.203424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8e7b2310-7d99-435b-92f7-0bb83da22256 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039896 Jul 19 15:44:40.203963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 565/1114] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:41.215685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:41.217249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:41.224348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:41.224798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:41.225598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:41.226031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:41.255690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f4c1e502-14d3-45ae-8db5-1da8e3b82491 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Jul 19 15:44:41.256251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 550/1115] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:42.267279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:42.268606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:42.275091 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:42.275537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:42.276303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:42.276733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:42.304902 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a0eb2d15-57f8-41e6-8504-821ec4f2bc37 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041583 Jul 19 15:44:42.305472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 566/1116] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:43.316975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:43.317920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:43.323965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:43.324416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:43.325214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:43.325644 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:43.354884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5a066b68-a5f3-4e47-a3b0-be3b4a95c4e4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042558 Jul 19 15:44:43.355440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 551/1117] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:44.367316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:44.368223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:44.374586 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:44.375022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:44.375785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:44.376213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:44.404142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b9860f71-ab8d-436c-8e30-9322617c7142 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041093 Jul 19 15:44:44.404677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 567/1118] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:45.415797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:45.416732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:45.423109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:45.423546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:45.425009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:45.425495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:45.453819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b78788db-68b5-4e35-824d-c9b508149dbc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 Jul 19 15:44:45.454349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 552/1119] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:46.465288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:46.466213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:46.472711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:46.473193 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:46.473965 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:46.474402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:46.504142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1e8d92b8-6aff-47cf-8383-0b498508cc80 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Jul 19 15:44:46.504617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 568/1120] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:47.515811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:47.516640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:47.523552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:47.523998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:47.524878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:47.525338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:47.553472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ca46ad81-43df-40dd-a5b5-677386900023 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 Jul 19 15:44:47.554013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 553/1121] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:48.565255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:48.566081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:48.572537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:48.572984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:48.573784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:48.574226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:48.603459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bd545b47-704a-4079-965c-5e10eedfafd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Jul 19 15:44:48.604014 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 569/1122] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:49.615356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:49.616185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:49.623208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:49.623658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:49.625105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:49.625105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:49.655041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-706b5c3f-019b-458c-8752-07fa21628637 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Jul 19 15:44:49.655490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 554/1123] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:50.667172 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:50.668027 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:50.674505 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:50.674948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:50.675853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:50.676279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:50.704453 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6e888356-f578-4248-b2ce-7381f6d2eabc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041293 Jul 19 15:44:50.704980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 570/1124] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:51.720902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:51.722549 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:51.729206 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:51.729654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:51.730418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:51.730845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:51.759472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-91977d3f-12db-4698-9772-35dc2869a440 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047440 Jul 19 15:44:51.760019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 555/1125] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:52.771682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:52.772595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:52.778996 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:52.779438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:52.780197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:52.780639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:52.808494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-23f648ce-cc7c-49b9-adbe-02e7e06708c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041226 Jul 19 15:44:52.809025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 571/1126] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:53.820771 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:53.821622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:53.828007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:53.828455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:53.829235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:53.829663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:53.857604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3d88751c-6896-41d4-9ba5-64bb3e3d13c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040827 Jul 19 15:44:53.858132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 556/1127] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:54.869442 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:54.870383 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:54.876713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:54.877179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:54.877936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:54.878358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:54.906160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0976adf4-6285-4db8-a845-68f1a5b94183 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040663 Jul 19 15:44:54.906698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 572/1128] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:55.919210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:55.920676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:55.931639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:55.932233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:55.933016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:55.933478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:55.962006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-198d8afd-1ff0-4967-a18e-3ffeb85e0125 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047837 Jul 19 15:44:55.962550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 557/1129] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:56.973560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:56.974480 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:56.980936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:56.981419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:56.982186 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:56.982616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:57.010970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e2d84dc6-f78b-47a5-a7ff-8777cdbe82ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041879 Jul 19 15:44:57.011495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 573/1130] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:58.022863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:58.023772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:58.030152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:58.030596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:58.031352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:58.031780 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:58.059992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7e2277de-cd47-41d0-abd2-611595304b96 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 Jul 19 15:44:58.060527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 558/1131] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:44:59.071855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:44:59.072778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:44:59.075075 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:59.080424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:59.081701 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:59.082325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:59.082791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:59.085332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:59.111527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-544953ee-8a3d-4184-8ba2-36a1015d07dc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Jul 19 15:44:59.112090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 574/1132] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:44:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:00.123441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:00.124377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:00.126773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.132124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:00.132563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:00.133346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:00.133776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:00.136241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:00.164235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3672c3cc-86a5-4d8d-a251-b14ea616477f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Jul 19 15:45:00.164783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 559/1133] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:01.176044 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:01.176944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:01.183450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:01.183891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:01.184644 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:01.185071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:01.213567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-84b2e6f9-c21b-453e-9835-fe5be06137b8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042029 Jul 19 15:45:01.214107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 575/1134] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:02.225473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:02.226383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:02.233067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:02.233539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:02.234291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:02.234721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:02.264175 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d8da0038-8657-4998-ad24-d5ab83e4c432 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Jul 19 15:45:02.264720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 560/1135] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:03.275770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:03.276721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:03.283326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:03.283780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:03.285191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:03.285628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:03.312813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5f2c9f5f-c555-437f-a360-3f846504f3ce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041042 Jul 19 15:45:03.313413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 576/1136] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:04.323967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:04.324821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:04.331508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:04.331947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:04.332708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:04.333165 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:04.362742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e2b74d41-fb8c-47d7-85ac-7adaefe9afb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 Jul 19 15:45:04.363286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 561/1137] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:05.374833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:05.375796 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:05.383192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:05.383641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:05.384445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:05.384887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:05.414490 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9f4662b5-9e80-4e81-977a-b1f273194941 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Jul 19 15:45:05.415079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 577/1138] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:06.425577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:06.426534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:06.432971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:06.433451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:06.434215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:06.434648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:06.462748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7a35ec87-31e1-43ef-aab1-523e19676c9a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Jul 19 15:45:06.463286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 562/1139] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:07.474625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:07.475564 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:07.482013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:07.482457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:07.483307 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:07.483740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:07.513459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-09ac6ff1-9a32-4635-af75-8b83650cc4f1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Jul 19 15:45:07.513934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 578/1140] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:08.525858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:08.526683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:08.533130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:08.533605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:08.535374 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:08.535815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:08.564124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aba64314-e5d7-42f4-9524-ad0d41b047c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 Jul 19 15:45:08.564680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 563/1141] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:09.575906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:09.576720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:09.583660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:09.584108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:09.584873 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:09.585349 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:09.612856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-aa373d5f-b2c6-475d-a842-c1c9c955dbd9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Jul 19 15:45:09.613432 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 579/1142] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:10.624535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:10.625410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:10.632018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:10.632459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:10.633240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:10.633669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:10.662326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3484256a-4510-4b81-be22-45713c91142c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Jul 19 15:45:10.662864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 564/1143] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:11.674234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.675061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:11.682048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:11.682489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:11.683245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:11.683670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:11.711807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7b98bb16-c1a0-48e0-be7e-c78ab39caa43 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041668 Jul 19 15:45:11.712350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 580/1144] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:12.722997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:12.723921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:12.730055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:12.730506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:12.731271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:12.731700 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:12.760530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dab3d699-40c3-4884-8276-5443bb2ddfee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041551 Jul 19 15:45:12.761096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 565/1145] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:13.773116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:13.774055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:13.780481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:13.780933 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:13.781725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:13.782157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:13.812585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2e5bbea5-fe82-469e-8d20-af16e5d4f232 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Jul 19 15:45:13.813166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 581/1146] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:14.824166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:14.825073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:14.832119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:14.832558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:14.833339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:14.833766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:14.861205 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9ef01f03-432d-4bcf-8c61-7169a96ca54d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040964 Jul 19 15:45:14.861735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 566/1147] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:15.872048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:15.872882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:15.880041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:15.880482 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:15.881266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:15.881694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:15.908911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fd10e911-9331-4a8d-a2b6-18aa09c99b36 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 Jul 19 15:45:15.909521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 582/1148] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:16.920418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:16.921353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:16.927720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:16.928160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:16.928919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:16.929409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:16.957172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2d05c2db-f6a1-4269-838f-e6c1498870fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040005 Jul 19 15:45:16.957721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 567/1149] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:17.968039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:17.968945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:17.976413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:17.976857 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:17.977635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:17.978064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:18.005922 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-74c7cb76-45f4-4827-96b8-730b8b2af72e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041911 Jul 19 15:45:18.006451 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 583/1150] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:19.017553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:19.018654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:19.025042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:19.025519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:19.026274 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:19.026699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:19.054788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e3c54482-9ed9-4a83-bacf-960349fbee6c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Jul 19 15:45:19.055332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 568/1151] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:20.066573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:20.067534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:20.074016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:20.074467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:20.075242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:20.075679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:20.103625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-aadbfd06-5fa2-4c10-b495-ae42156af740 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041214 Jul 19 15:45:20.104164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 584/1152] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:21.116018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:21.116918 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:21.123419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:21.123863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:21.124620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:21.125047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:21.153570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea04cdda-29cd-4d57-941e-f87638e08d5b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Jul 19 15:45:21.154107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 569/1153] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:22.165478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:22.166393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:22.172769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:22.173256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:22.174024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:22.174457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:22.203219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-af76135f-895a-4275-9a27-b19c383f8078 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Jul 19 15:45:22.203783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 585/1154] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:23.215295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:23.216207 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:23.222668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:23.224227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:23.224995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:23.225451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:23.255523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-219494ff-7853-4df2-aedc-4898f7d76def tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Jul 19 15:45:23.256091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 570/1155] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:24.266982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:24.267957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:24.275157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:24.275606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:24.276368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:24.276803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:24.305718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-79cde510-63e8-467d-887d-73455d623d12 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042337 Jul 19 15:45:24.309221 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 586/1156] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:25.315866 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:25.317329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:25.323693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.324134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.324887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.325354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.353529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-61ae0620-8819-4591-98b6-b64ba6d480dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041591 Jul 19 15:45:25.354074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 571/1157] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:26.323351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:26.323923 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:26.330365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:26.330809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:26.331567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:26.332001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:26.365709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:26.366662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:26.373129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:26.373604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:26.374401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:26.374836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:26.404770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-88140ab5-fc70-4d40-9e90-15f52fac4438 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Jul 19 15:45:26.405359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 572/1158] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:26.462676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.objects.instance [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lazy-loading 'services' on Instance uuid 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc {{(pid=118006) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:45:26.532177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e0434714-acef-4487-9395-826228b3bae0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc/os-volume_attachments/a58cb7c1-58e7-47a2-835a-26892967d0a8" status: 202 len: 0 microversion: 2.1 time: 0.212568 Jul 19 15:45:26.532834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 587/1159] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:45:26 2022] DELETE /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc/os-volume_attachments/a58cb7c1-58e7-47a2-835a-26892967d0a8 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:45:27.416116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:27.417058 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:27.423482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.423920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.424672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.425096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.453773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-82df69ec-1aa1-4d2f-b61e-3330ab52f2f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041590 Jul 19 15:45:27.454311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 573/1160] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:28.465585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:28.466584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:28.473352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.474104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.474877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.475311 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.504026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1eb2ad2a-4e2c-44c2-a1ed-24bd5adce2ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043219 Jul 19 15:45:28.504815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 588/1161] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:29.515911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:29.516770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:29.523632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.524080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.524840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.525303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.553215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-096a594c-ddcb-440c-afe0-8f071067d931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041306 Jul 19 15:45:29.553754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 574/1162] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:30.564813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:30.565715 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:30.568563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:30.574290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.574734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.575485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.575911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.579741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:30.606151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1e53eb6e-c1ce-4352-b3ce-4f8c31a48802 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045380 Jul 19 15:45:30.606689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 589/1163] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:31.617754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:31.618730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:31.621093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=32 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:31.626815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.627264 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.628031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.628461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.632831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=96 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:31.659173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a100efe2-f7a4-4d8b-83e6-bd7bdaa84da9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Jul 19 15:45:31.659898 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 575/1164] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:32.670782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:32.671689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:32.678332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.678771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.679525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.679953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.708553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8a8c8ee4-edd2-49c2-92ee-627b76b4feb1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041611 Jul 19 15:45:32.709085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 590/1165] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:32.861626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:45:32.862141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:45:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:45:33.604605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:45:33.604828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:45:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:45:33.720117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:33.721021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:33.728294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.728738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.729536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.729981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.758118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ef4de018-1eca-4c10-99fb-6fbd59032c3e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042017 Jul 19 15:45:33.758653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 576/1166] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:34.770143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:34.771030 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:34.777549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.777937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.778684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.779110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.808123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-140fe812-8b92-48ca-a2e6-b0a9eee5450d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042339 Jul 19 15:45:34.808660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 591/1167] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:35.819959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:35.820885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:35.827409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.827856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.828624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.829054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.856982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d48522ff-1dfd-4bc4-a6f1-5cbea9109535 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041249 Jul 19 15:45:35.857539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 577/1168] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:36.869062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:36.870001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:36.876337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.876780 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.877568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.877995 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.906359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-081883ed-814e-4a51-9f87-fcbc4393018a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Jul 19 15:45:36.906891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 592/1169] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:37.918500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:37.919413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:37.925823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.926268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.927020 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.927717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.955634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9455757e-c54e-43ab-93c1-3e0e49165350 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041087 Jul 19 15:45:37.956162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 578/1170] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:38.968425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:38.969367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:38.976510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.976947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:38.977734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.978163 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:39.006981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0731732f-4b77-4baa-b989-7e12df5125bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Jul 19 15:45:39.007517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 593/1171] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:40.019198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:40.020119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:40.027042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.027492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.028252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.028683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.057931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2b37c610-b5d5-49cf-9f63-c1f67889fb31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 Jul 19 15:45:40.058466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 579/1172] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:41.070423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:41.071340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:41.077508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:41.077957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:41.078726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:41.079162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:41.107874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5f447cf8-f70d-4ab7-b60b-b9b96816c215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 Jul 19 15:45:41.108417 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 594/1173] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:42.120094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:42.121020 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:42.127824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.128275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.129041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.129501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.159180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d896a1cd-5a7c-4948-a507-3fdd7cc72235 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 Jul 19 15:45:42.159709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 580/1174] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:43.170869 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:43.171772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:43.178360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.178799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.179552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.179975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.208069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1533d017-1971-49da-9dd5-215f2f0ab223 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041112 Jul 19 15:45:43.209536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 595/1175] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:44.220864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:44.221793 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:44.228718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:44.229181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:44.229937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:44.230363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:44.259435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-98b666b3-b028-47d4-922a-4828d222d973 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042465 Jul 19 15:45:44.259988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 581/1176] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:45.278443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:45.279393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:45.285949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.286988 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.287841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.288292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.316218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0329ed7d-9043-409b-aac7-80cfd55df043 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041726 Jul 19 15:45:45.316760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 596/1177] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:46.327936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:46.328854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:46.335877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.336326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.337084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.337542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.367330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-885abc27-9a18-4aae-b58c-a4e157c0cb2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Jul 19 15:45:46.367869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 582/1178] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:47.378875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:47.379813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:47.386340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.386794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.387555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.387982 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.417053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eaf60102-5182-46a0-b4b5-468f310fa4c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 Jul 19 15:45:47.417664 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 597/1179] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:48.428698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:48.429641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:48.436098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.436542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.437335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.437769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.465557 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-44563805-458c-46ec-9fc6-1dd61f1f0b9e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Jul 19 15:45:48.466094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 583/1180] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:49.476391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:49.477329 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:49.483761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.484201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.484955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.485408 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.513637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0b66ad92-8148-4fce-b32c-b0c39d413493 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041081 Jul 19 15:45:49.514116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 598/1181] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:50.526317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:50.527160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:50.533682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.534129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.534889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.535320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.563732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a2effe32-c2c5-4ad2-860d-dad04f3db554 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Jul 19 15:45:50.564280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 584/1182] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:51.575510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:51.576458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:51.583627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.584094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.584855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.585332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.612884 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2bd27333-fb58-447f-9ee7-930884ecd1e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041302 Jul 19 15:45:51.613465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 599/1183] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:52.624082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:52.624950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:52.631709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.632153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.632907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.633375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.662100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b0589b6c-98a6-4bb1-afe6-8aad97958215 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041460 Jul 19 15:45:52.662632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 585/1184] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:53.673640 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:53.674563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:53.681168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.681623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.682386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.682819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.711690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7442e272-0480-4bca-a133-4c58c3f867de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Jul 19 15:45:53.712224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 600/1185] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:54.722710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:54.724243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:54.730688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.731131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.731883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.732315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.760618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0176b49e-0fe4-4a73-8ea1-49392c6758be tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041882 Jul 19 15:45:54.761348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 586/1186] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:55.492460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:45:55.493029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:45:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:45:55.772632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:55.773587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:55.780071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.780519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.781309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.781742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.809917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6d372e6c-32ed-4806-89b4-731665ded12f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 Jul 19 15:45:55.810448 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 601/1187] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:56.822558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:56.823477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:56.829924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.830372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.831133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.831564 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.861273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-af9ebf49-ad4c-428e-a4d8-90ec50023dd7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jul 19 15:45:56.861819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 587/1188] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:57.873509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:57.874426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:57.881466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.881915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.882670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.883100 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.912551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5ea63607-036d-4da9-afaa-056c1c803666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Jul 19 15:45:57.913080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 602/1189] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:58.924134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:58.925091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:58.932160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.932606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.933416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.933856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.961453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4f9bce6d-61ec-44fb-93d3-7a27fa12b811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041318 Jul 19 15:45:58.961987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 588/1190] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:59.972134 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:59.973049 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:59.979513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.979957 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.980750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.981203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.009039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f7513967-e54a-4942-83bf-febb58b7bf21 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040915 Jul 19 15:46:00.009611 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 603/1191] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:45:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:01.021155 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:01.022087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:01.028588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.029037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.029831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.030265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.058960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a331937d-2056-4183-8558-4c983e81f7de tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jul 19 15:46:01.059493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 589/1192] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:02.070385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:02.071294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:02.073561 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:02.079217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.079658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.080416 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.080873 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.084985 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:02.109778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4fe01ed6-4a13-4c6b-96f1-424181d7cddb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Jul 19 15:46:02.110324 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 604/1193] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:03.121560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:03.122510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:03.124849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:03.130862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.131306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.132071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.132503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.135032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:03.161185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-936aa5dd-d5b0-41c1-a3af-ee058739db15 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jul 19 15:46:03.161732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 590/1194] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:04.172887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:04.173849 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:04.181012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.181486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.182242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.182669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.213980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b3d44d6a-fa24-40f2-8c47-035f58f27a59 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Jul 19 15:46:04.214746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 605/1195] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:05.225943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:05.226882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:05.233372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.233816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.234575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.235006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.264478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-87d1c6e3-9fc5-4f9c-9175-0e017911c84e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Jul 19 15:46:05.265029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 591/1196] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:06.276643 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:06.277587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:06.284020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.284466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.285259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.285696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.313444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2a674fbf-cf06-4e64-8f5b-a11a76f70f97 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040787 Jul 19 15:46:06.313987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 606/1197] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:07.326287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:07.327209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:07.333814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.334262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.335050 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.335492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.364010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d80ca26c-e1ff-4dac-98d2-fec9484454f7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041686 Jul 19 15:46:07.365245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 592/1198] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:08.376213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:08.377177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:08.384615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.385061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.385858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.386287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.415012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb12682d-606b-4da5-84f4-0b16942d3e6e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042795 Jul 19 15:46:08.415555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 607/1199] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:09.427243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:09.428162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:09.434831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:09.435275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:09.436027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:09.436587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:09.466671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bd843bfc-445f-4592-89bf-0ee7351ee868 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 19 15:46:09.467231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 593/1200] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:10.479382 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:10.480326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:10.486810 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.487256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.488035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.488489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.524007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-01e28395-8c84-4861-906b-95cd4961a170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048928 Jul 19 15:46:10.524496 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 608/1201] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:11.535861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:11.537157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:11.543602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.544050 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:11.544808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.545283 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:11.574674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6a0515fa-8950-4419-b6b0-55af9f05531d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 Jul 19 15:46:11.575208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 594/1202] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:12.587374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:12.588215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:12.594634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.595083 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.595843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.596276 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.624361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4b05f376-faa3-43e0-b96b-5de87b8e2bed tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 Jul 19 15:46:12.624905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 609/1203] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:13.637587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:13.638768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:13.645448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:13.646038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:13.646817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:13.647338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:13.675170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9bbb7430-0e2c-4ca4-b9fb-91483cb83994 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042511 Jul 19 15:46:13.675719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 595/1204] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:14.687577 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:14.688415 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:14.695488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:14.695940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:14.696698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:14.697131 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:14.725392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-32490a70-11e4-43a5-876a-12dbe532eb23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Jul 19 15:46:14.725608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 610/1205] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:15.736581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:15.737521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:15.745223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:15.745671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:15.746424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:15.746853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:15.775616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9d610d72-92ff-43a8-a961-8fa4d384897c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Jul 19 15:46:15.776185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 596/1206] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:16.788243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:16.789165 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:16.795628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:16.796071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:16.796826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:16.797288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:16.824228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7fefc066-30fc-4917-bc30-2338b3c1bbdb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040544 Jul 19 15:46:16.824758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 611/1207] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:17.836480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:17.837420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:17.843834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:17.844280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:17.845043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:17.845503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:17.874208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dcbfd36f-d5ca-46dd-852a-c37ba858217b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042200 Jul 19 15:46:17.874736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 597/1208] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:18.885447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:18.886365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:18.892794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:18.893350 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:18.894388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:18.894826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:18.922623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-080328f4-fa9b-4872-b4e3-719684cc61d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Jul 19 15:46:18.923169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 612/1209] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:19.934917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:19.935790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:19.942262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:19.942703 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:19.943981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:19.944603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:19.973625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0c620fa3-8647-493e-8e25-08cd40274980 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Jul 19 15:46:19.974167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 598/1210] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:20.985524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:20.986483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:20.993516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:20.993968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:20.994732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:20.995169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:21.023799 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a854da9e-432a-4829-a858-9c6ab3f85ca3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 Jul 19 15:46:21.024347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 613/1211] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:22.035525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:22.036477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:22.043530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.043973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.044736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.045188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.075421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f9dcb697-f8d5-4424-ba40-3f0cb0dad217 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Jul 19 15:46:22.075959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 599/1212] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:46:23.088758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:23.089703 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:23.096121 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.096581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:23.097381 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.097818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:23.125757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1b73d927-7d30-4d53-a40e-1891e7bb086c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Jul 19 15:46:23.126303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 614/1213] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:24.137574 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:24.138491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:24.145262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:24.145818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.147135 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:24.147861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.176304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eef66c16-7d2d-4fc7-ba70-cebb210ac599 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Jul 19 15:46:24.176843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 600/1214] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:25.188210 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:25.189123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:25.195937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.196378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.197130 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.197615 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.225814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a32d4bba-7d66-4dbe-a154-7a262bdb0cb8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Jul 19 15:46:25.226550 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 615/1215] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:26.237748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:26.238672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:26.246396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.246845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.247654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.248167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.278677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b31b1ea3-e466-4b4a-a1b7-dec701f196ee tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Jul 19 15:46:26.279230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 601/1216] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:27.291021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:27.291928 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:27.298365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.298807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.299555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.299980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.327377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f838ae39-1a14-4cf2-b02d-cd36e23870a6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041107 Jul 19 15:46:27.327907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 616/1217] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:28.339534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:28.340495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:28.346925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.347365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.348113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.348538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.377550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c2ed3123-5dfc-421f-997a-25bd28aa042c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041895 Jul 19 15:46:28.378121 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 602/1218] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:29.389657 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:29.390576 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:29.397943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:29.398386 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:29.399145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:29.399575 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:29.427741 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9cc8c254-d450-4f6b-88d7-1dd62d5b223e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042312 Jul 19 15:46:29.429353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 617/1219] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:30.439772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:30.440687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:30.447789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:30.448240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:30.449033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:30.449614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:30.478146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-243dd775-bc4d-4510-9b08-7a02f9a7bca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Jul 19 15:46:30.478681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 603/1220] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:31.489645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:31.491108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:31.497640 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:31.498092 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:31.498853 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:31.499286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:31.528818 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-32615d5b-9dc4-4e81-8f20-7aea8fae8913 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jul 19 15:46:31.529409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 618/1221] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:32.540655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:32.541535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:32.548071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:32.548522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:32.549326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:32.549759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:32.578710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-134f9018-b4f7-45fb-a6f7-be9fe2f96d08 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042187 Jul 19 15:46:32.579248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 604/1222] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:33.590389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:33.591225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:33.593656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:33.599333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:33.599776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:33.600744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:33.601233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:33.604917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:33.630289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-90c351f4-78a1-422c-a429-a50c250f492a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Jul 19 15:46:33.630834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 619/1223] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:46:34.642385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:34.643219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:34.645914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:34.651220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:34.651674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:34.652442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:34.652882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:34.657477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:34.682159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5fc939ce-7100-4692-adb3-dacfd1ac36c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Jul 19 15:46:34.682696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 605/1224] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:35.693916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:35.694824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:35.701450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:35.701856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:35.702613 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:35.703042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:35.730774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6b2aa95e-e121-4c3e-8930-6295c9c9c784 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040831 Jul 19 15:46:35.731317 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 620/1225] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:36.743030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:36.743953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:36.751327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:36.751774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:36.752539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:36.752974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:36.781031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3232ea6c-04e5-4fdc-bb7d-1a90cb98464d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042002 Jul 19 15:46:36.781636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 606/1226] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:37.792572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:37.793779 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:37.800116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:37.800557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:37.801345 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:37.801772 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:37.830363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-57cb5dbe-c2a8-4ef1-8fe6-c68053740945 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041728 Jul 19 15:46:37.830898 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 621/1227] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:38.842603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:38.843551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:38.850012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:38.850461 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:38.851225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:38.851659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:38.879235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-28c4c674-da4a-48ac-ad21-e05c50b1de9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 Jul 19 15:46:38.879765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 607/1228] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:39.890770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:39.891682 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:39.898110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:39.898552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:39.899305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:39.899731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:39.928267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-805c92bc-5f6d-44e8-bb3d-6706cba504fd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Jul 19 15:46:39.928793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 622/1229] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:40.940457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:40.941509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:40.947958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:40.948412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:40.949202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:40.949639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:40.977315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c1907413-f994-4f45-bd14-82680a3fa1df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041436 Jul 19 15:46:40.977863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 608/1230] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:41.988978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:41.989956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:41.996549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.997007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:41.998333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.998791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:42.028194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-84d740e7-6f5b-4b34-8337-73b95c2bd7ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Jul 19 15:46:42.028748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 623/1231] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:43.040009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:43.040926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:43.048462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.048938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.049863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.050306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.079037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ba5436c1-2a5b-4e75-9fa1-12fad5a6a248 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 Jul 19 15:46:43.079580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 609/1232] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:44.090656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:44.091609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:44.097963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:44.098402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:44.099156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:44.099584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:44.127525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-061ae4b2-f83e-446e-a65b-2ab3cfccc4ea tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040884 Jul 19 15:46:44.128055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 624/1233] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:45.139651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:45.140562 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:45.147402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:45.147850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:45.148618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:45.149055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:45.177635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f91ed9d5-24ad-4607-be30-d69610f52c3c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042507 Jul 19 15:46:45.178179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 610/1234] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:46.189755 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:46.190684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:46.196530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.197000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.197778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.198207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.226518 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ed663954-5087-424b-bdac-cb31a003f82f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041367 Jul 19 15:46:46.227054 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 625/1235] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:47.238362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:47.239278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:47.245843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.246287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.247053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.247485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.276936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5872a9c9-f693-4b84-9745-a8b053a8648d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Jul 19 15:46:47.277732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 611/1236] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:48.289087 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:48.290039 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:48.296739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.297224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.298026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.298454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.327322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-750dd456-8bf7-4a81-809a-8018208b60d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Jul 19 15:46:48.327869 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 626/1237] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:49.338140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:49.339052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:49.346013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.346457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:49.347217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.347648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:49.376847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-145b60bf-da6e-48b2-8ede-f92a1917aaba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Jul 19 15:46:49.377433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 612/1238] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:50.387851 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:50.388764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:50.395688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:50.396175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:50.396979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:50.397450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:50.426319 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-86f00b98-76ea-4d39-95da-8168b11b9e3d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 Jul 19 15:46:50.426863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 627/1239] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:51.438539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:51.439462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:51.445928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.446377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:51.447179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.447615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:51.476291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-94de5acd-329b-48cf-8e93-2d73b26e629f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042392 Jul 19 15:46:51.476837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 613/1240] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:52.487841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:52.488746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:52.495152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:52.495591 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:52.496338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:52.496764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:52.525181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eb1128c8-49d5-4015-a1f4-f3bd43f2123c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 Jul 19 15:46:52.525662 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 628/1241] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:46:53.536748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:53.537612 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:53.544011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.544455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.545243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.546271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.574577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f354ba13-1487-4c61-9dd0-b21f2e0bdb41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041896 Jul 19 15:46:53.575116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 614/1242] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:54.586450 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:54.587331 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:54.593868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.594320 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.595089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.595558 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.623158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-83adf141-3e5a-4331-a75e-d41eb8817f65 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040815 Jul 19 15:46:54.624195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 629/1243] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:55.635473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:55.636418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:55.643063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.643777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.644535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.644968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.673062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c760a54b-16a9-4259-8ccb-748ca68fd5c7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Jul 19 15:46:55.673617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 615/1244] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:56.684255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:56.685178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:56.692278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.692720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.693495 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.693925 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.722497 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-40f1badd-ec6d-4613-9c61-a0c64f48d170 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042186 Jul 19 15:46:56.723031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 630/1245] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:57.734268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:57.735216 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:57.741600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:57.742041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:57.742791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:57.743241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:57.771294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d7668f2a-753b-4051-8622-a3374ac39b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Jul 19 15:46:57.771824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 616/1246] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:58.783739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:58.784662 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:58.791042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.791477 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.792226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.792690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.820901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-32343423-c0b9-4992-833d-5bd76acc4698 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042003 Jul 19 15:46:58.821463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 631/1247] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:59.832057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:59.832970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:59.839474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.839920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.840684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.841113 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.870476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8d4a184e-f5d5-4674-89a3-7f37f684cca6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Jul 19 15:46:59.871017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 617/1248] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:00.882081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:00.883000 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:00.889508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.889960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.890738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.891175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.918648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0ef9acf8-e218-47fa-adb9-e191ff0a80b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040496 Jul 19 15:47:00.919189 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 632/1249] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:01.931126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:01.931990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:01.939053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.939494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.940254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.940687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.969133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6804e991-bde1-4c1e-b307-5128d1e1b85e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Jul 19 15:47:01.969695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 618/1250] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:02.980742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:02.981676 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:02.988137 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.988576 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.989379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.989807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.017535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8dec0fee-dcc4-4741-ab84-5a514991367c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040696 Jul 19 15:47:03.018064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 633/1251] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:04.030775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:04.031697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:04.038180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.040120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.040120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.040120 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.071423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-adaa7536-d9f1-44e5-95ec-b992675a0cd3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Jul 19 15:47:04.071971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 619/1252] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:05.083824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:05.084735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:05.087009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=30 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:05.092379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.092827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.093614 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.094046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.096493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=90 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:05.122357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-aa7b6518-e0fe-4d23-b1d6-003a8037fdef tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 Jul 19 15:47:05.122900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 634/1253] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:06.134676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:06.135579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:06.137940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=30 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:06.144186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.144628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.145409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.145837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.149335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=90 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:06.174660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6ccdcff4-378b-42de-9dc2-43d592f5416d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Jul 19 15:47:06.175211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 620/1254] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:07.190795 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:07.191716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:07.197782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.198236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.199005 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.199440 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.228524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8133815e-512d-4efc-a2ff-9c7ab2cbcdf9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Jul 19 15:47:07.229072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 635/1255] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:08.240618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:08.241566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:08.247978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.248426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.249226 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.250324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.278602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f8f314ac-8c00-4090-b844-9ff34d511b93 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041971 Jul 19 15:47:08.279151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 621/1256] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:09.290306 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:09.291219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:09.297763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.298203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.298956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.299385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.327571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fca1feb5-f359-4e29-9085-a06c8c521537 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041338 Jul 19 15:47:09.328106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 636/1257] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:10.338620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:10.339589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:10.346131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.346600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.347371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.347811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.376269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f47fbb79-c16b-4d7c-affa-f95016ef5c5d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041697 Jul 19 15:47:10.376835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 622/1258] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:11.387397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:11.388303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:11.395508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.395949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.396702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.397127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.425877 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-873866eb-c7de-4091-8d6f-de1cfe1f5cd2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042426 Jul 19 15:47:11.426437 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 637/1259] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:12.437970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:12.438946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:12.445227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.445670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.446420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.446845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.475379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93ede254-c760-4084-a946-4150f7edac4d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041400 Jul 19 15:47:12.475927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 623/1260] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:13.487666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:13.488573 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:13.495024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.495470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.496220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.496646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.525191 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f71b4cfb-502e-4774-98ed-de9427302b44 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042160 Jul 19 15:47:13.525735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 638/1261] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:14.527487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:47:14.527980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:47:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:47:14.537420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:14.538463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:14.545179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.545626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.546378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.546828 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.574961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4499ac0e-3d20-48d2-b42f-99f5add44eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Jul 19 15:47:14.575497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 624/1262] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:47:15.587094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:15.588742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:15.596224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.596674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.597475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.597906 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.626126 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1342f6bc-0e38-460b-b71c-1b446cddc30c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jul 19 15:47:15.626679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 639/1263] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:16.638109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:16.639411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:16.646808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.647256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.648019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.648448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.677942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05e74f9b-3d7e-407b-89b7-665a44d3d75f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 Jul 19 15:47:16.678480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 625/1264] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:17.690387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:17.691220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:17.697816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.698267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.699042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.699479 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.728572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8d729503-216f-4b53-96f2-65c7ad661091 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 19 15:47:17.729127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 640/1265] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:18.740026 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:18.740938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:18.747441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:18.747909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:18.748658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:18.750142 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:18.780187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3aac3f6e-602d-4054-8996-9f026fe71b50 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Jul 19 15:47:18.780723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 626/1266] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:19.792725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:19.793667 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:19.800931 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.801414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.802182 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.802625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.830720 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b001d293-9a9d-49ba-980d-a554dea59d5e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042086 Jul 19 15:47:19.831256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 641/1267] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:20.842415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:20.843326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:20.849986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.850429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.851185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.851609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.879930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9dfc90c7-e52d-41cb-a4d4-6e941d3478f4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041442 Jul 19 15:47:20.880492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 627/1268] 10.222.0.42 () {58 vars in 1301 bytes} [Tue Jul 19 15:47:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:21.892443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:21.893659 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:21.900042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.900486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.901264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.901695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.980354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6ea20d39-3afb-4c65-893d-298ddba14e64 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action" status: 200 len: 83694 microversion: 2.1 time: 0.092282 Jul 19 15:47:21.980985 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 642/1269] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Jul 19 15:47:21 2022] POST /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/action => generated 83694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:47:21.993656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:21.994152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:22.000674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.001122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.001908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.002337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.125001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.objects.instance [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lazy-loading 'services' on Instance uuid 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf {{(pid=118007) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:47:22.182468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.wsgi [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Request method failure captured: Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: request: DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments/535b4dd5-a3e3-4840-bfb3-021d5b5c2374 HTTP/1.1 Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept: application/json Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Accept-Encoding: identity Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Connection: close Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Length: 0 Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Content-Type: application/json Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Host: 10.222.0.42 Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Openstack-System-Scope: None Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: User-Agent: python-urllib3/1.26.9 Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Auth-Token: gAAAAABi1tACHEGuP-9XTkGb9D9VB2bdiiBZvS4PAvxKLuRXF4_hbyDed9vEmJS4pxmTONfWkeSiD8ewLqxAZteQ1SRhL0UsniHMgGFC3hDHqYLo5Xtfb1jK_I02vgKT-iq34fuaBFd2tITlEeF3-9pq9-EXS3OVvfoU_-HLB9wZvAbuE2MBaZE Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Id: None Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Domain-Name: None Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Identity-Status: Confirmed Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Is-Admin-Project: True Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Id: default Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Domain-Name: Default Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Id: 05857a00bdb14c54800b5e0f55ed27fc Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Project-Name: tempest-TestMinimumBasicScenario-1598806601 Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Role: reader,member Jul 19 15:47:22.184729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Roles: reader,member Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05857a00bdb14c54800b5e0f55ed27fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05857a00bdb14c54800b5e0f55ed27fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05857a00bdb14c54800b5e0f55ed27fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05857a00bdb14c54800b5e0f55ed27fc"}]}] Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant: tempest-TestMinimumBasicScenario-1598806601 Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Id: 05857a00bdb14c54800b5e0f55ed27fc Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1598806601 Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User: tempest-TestMinimumBasicScenario-1598806601-project Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Id: default Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Domain-Name: Default Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Id: 15af8262a49946739a79f12ec7f8b15d Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: X-User-Name: tempest-TestMinimumBasicScenario-1598806601-project Jul 19 15:47:22.186339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: method: > Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: action_args: {'server_id': '3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf', 'id': '535b4dd5-a3e3-4840-bfb3-021d5b5c2374'} Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 15:47:22.187068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:47:22.188871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:22.190243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:22.191327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) Jul 19 15:47:22.192559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR nova.api.openstack.wsgi Jul 19 15:47:22.193848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-84b8765f-fa73-48ba-ac84-7032e60f81fe) {{(pid=118007) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:47:22.193848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c48b51db-af7d-4e47-b2ef-fa1c81efdee3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments/535b4dd5-a3e3-4840-bfb3-021d5b5c2374" status: 400 len: 269 microversion: 2.1 time: 0.196529 Jul 19 15:47:22.193848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 628/1270] 10.222.0.42 () {58 vars in 1415 bytes} [Tue Jul 19 15:47:21 2022] DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf/os-volume_attachments/535b4dd5-a3e3-4840-bfb3-021d5b5c2374 => generated 269 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:47:36.145104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:47:36.145765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:47:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:48:52.872056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:48:52.872886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:48:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:48:53.613725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:48:53.614296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:49:15.500006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:49:15.500726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:49:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:50:34.543004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:50:34.543733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:50:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:50:56.154336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:50:56.154978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:50:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:51:26.118713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: ERROR oslo.messaging._drivers.impl_rabbit [-] [153950a3-3951-4a9b-952e-dadc2288fd5c] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 19 15:51:26.119576 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=17 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:26.120304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=51 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:26.124825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:26.125503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:26.132485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.133389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.134161 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.134595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.160218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Going to try to terminate instance {{(pid=118006) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:51:26.235274 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9b3bc9cb-9da1-4100-9567-baa26ec13b5c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "DELETE /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 204 len: 0 microversion: 2.1 time: 0.118597 Jul 19 15:51:26.235856 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 643/1271] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:51:26 2022] DELETE /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:51:26.242818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef8fe583-5868-4a39-9e2d-5823f63d4205] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 15:51:26.243474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=17 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:26.244476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=55 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:26.249183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:26.249800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:26.256730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.257202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.258785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.259228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.388311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:26.396532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-31bdd486-be32-40de-afb7-08f04713b43d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156449 Jul 19 15:51:26.397115 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 629/1272] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:27.414229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:27.414919 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:27.424164 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.424608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.425410 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.425865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.432411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] [153950a3-3951-4a9b-952e-dadc2288fd5c] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38330. Jul 19 15:51:27.762135 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:27.770827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-b2cc64db-99eb-420e-8baa-1cbc2660a866 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.360864 Jul 19 15:51:27.771389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 644/1273] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:27 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:28.787914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:28.788449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:28.795685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:28.796131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:28.796885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:28.797348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:28.813521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef8fe583-5868-4a39-9e2d-5823f63d4205] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38338. Jul 19 15:51:28.927669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:28.936245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-268c2378-8eb0-4788-906a-90f4bb7b75cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152320 Jul 19 15:51:28.936832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 630/1274] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:29.954041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:29.954653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:29.961429 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:29.961875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:29.962648 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:29.963101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:30.093839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:30.101858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-baeccd40-0563-4aac-b600-da120bd45adf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151160 Jul 19 15:51:30.102427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 645/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:29 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:31.119532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:31.120133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:31.126705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:31.127150 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:31.127904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:31.128332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:31.259125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:31.267381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a309bbb9-7ff2-4b34-b6ed-8bf7782a4ee0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151904 Jul 19 15:51:31.267931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 631/1276] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:32.283751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:32.284360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:32.291848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.292297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:32.293066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.293525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:32.422097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:32.430934 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0c9e0d8f-7cc8-4bad-a575-d41339d96ef3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151054 Jul 19 15:51:32.431486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 646/1277] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:32 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:33.448628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:33.449190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:33.455588 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:33.456034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:33.456793 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:33.457252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:33.589001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:33.596940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93731803-4c30-4b6e-a08b-60e19c66a31f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152891 Jul 19 15:51:33.597516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 632/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:33 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:34.613539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:34.614146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:34.620876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.621355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.622119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.622553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.747846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:34.755698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-45677d2c-fe1f-4f46-95e1-ba2da2ddaf3e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145949 Jul 19 15:51:34.756194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 647/1279] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:35.773939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:35.775642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:35.782083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:35.782527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:35.783316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:35.783744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:35.913503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:35.922043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d7eef5a6-814b-4f1d-9cde-098f3c1f8ad1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151922 Jul 19 15:51:35.922613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 633/1280] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:36.939145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:36.939708 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:36.946356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:36.947340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:36.948102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:36.948539 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:37.075170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:37.082966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7ef61642-1172-4ace-b694-f55c740e22cf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147766 Jul 19 15:51:37.083519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 648/1281] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:36 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:38.099878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:38.100477 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:38.107741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.108193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.108991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.109464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.236837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:38.245557 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e13849e4-873f-48c4-8cb8-b81edb61faf5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149468 Jul 19 15:51:38.246126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 634/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:39.263173 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:39.263800 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:39.270457 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:39.270901 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:39.271653 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:39.272085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:39.403769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:39.411544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-86095cb2-ab3d-41dc-af35-030e98502951 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152857 Jul 19 15:51:39.412104 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 649/1283] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:39 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:40.428832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:40.429489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:40.436195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.436647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.437451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.437898 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.565337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:40.574025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1b0b367f-dfd6-48f3-9e0b-3718290953ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149076 Jul 19 15:51:40.574683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 635/1284] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:40 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:41.591716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:41.592304 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:41.598652 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:41.599089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:41.599839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:41.600270 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:41.730852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:41.738970 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ad895383-7e72-474e-8cea-acb08863f71f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151125 Jul 19 15:51:41.739533 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 650/1285] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:42.756480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:42.757090 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:42.764211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:42.764606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:42.765414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:42.765845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:42.890729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:42.898796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e195a56a-72de-409e-9263-6a32b3929ef0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146152 Jul 19 15:51:42.899351 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 636/1286] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:43.916503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:43.917076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:43.923609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:43.924059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:43.924835 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:43.925299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:44.057162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:44.065048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-05a7f252-a03a-4870-ab42-5ee609728baf tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153174 Jul 19 15:51:44.065642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 651/1287] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:43 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:45.082448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:45.083048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:45.090194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:45.090632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:45.091382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:45.091813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:45.221073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:45.229425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b520083e-c757-4290-9210-8c68f9d1eed1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150759 Jul 19 15:51:45.230022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 637/1288] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:46.246583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:46.247194 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:46.254101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:46.254254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:46.255023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:46.255465 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:46.380917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:46.389754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e9b65a1e-b547-4710-a06a-a63003d98da7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147187 Jul 19 15:51:46.390316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 652/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:47.407088 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:47.407689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:47.414094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.414534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:47.415292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.416899 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:47.544970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:47.552859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-73808952-dc16-4093-b64b-65fa1df8a90c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149686 Jul 19 15:51:47.553447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 638/1290] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:48.569861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:48.570463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:48.577926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:48.578364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:48.579114 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:48.579542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:48.708670 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:48.717001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-38d63937-ba51-4f75-ad20-4633f21f783e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151013 Jul 19 15:51:48.717681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 653/1291] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:48 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:49.734314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:49.734921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:49.741519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:49.742055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:49.742794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:49.743227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:49.874365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:49.882231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9cdd2724-5cbf-4bc7-851f-21a7d248fa97 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151843 Jul 19 15:51:49.882784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 639/1292] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:50.900219 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:50.901582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:50.908032 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:50.908485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:50.909279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:50.909722 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:51.043911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:51.051890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6b48f13a-8d09-46b2-8132-d8e2aa7f75c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155581 Jul 19 15:51:51.052454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 654/1293] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:50 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:52.068795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:52.069423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:52.076719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:52.077204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:52.077966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:52.078525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:52.209843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:52.218495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a47fb401-42ea-4e45-bd29-8819c298889b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153499 Jul 19 15:51:52.219059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 640/1294] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:52 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:53.235348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:53.235956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:53.242597 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:53.243040 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:53.243806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:53.245379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:53.371695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:53.379820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d2845df1-32fd-4d72-a509-09cfa76aec04 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148258 Jul 19 15:51:53.380395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 655/1295] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:53 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:54.397817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:54.398396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:54.405276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:54.405724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:54.406476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:54.406902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:54.535726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:54.544293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9c8730fb-ba04-485e-b2cb-9d4a3ca56921 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150724 Jul 19 15:51:54.544846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 641/1296] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:55.561434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:55.562059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:55.568384 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:55.568825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:55.569619 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:55.570048 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:55.701031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:55.708825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ec504387-4a27-4085-b311-b5d58e4b62ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151263 Jul 19 15:51:55.709413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 656/1297] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:55 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:56.726576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:56.727185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:56.730462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=27 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:56.735838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.736275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.737030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.737485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.741465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=79 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:56.867146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:56.875102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f5df5e3f-4921-4756-863a-c014ce1a9bb1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152745 Jul 19 15:51:56.875665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 642/1298] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:57.892420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:57.893022 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:57.894872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:57.900192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:57.900632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:57.901517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:57.901947 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:57.905237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:58.033551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:58.041316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dc8ee2a5-2f7d-458e-8ee4-1d9a75882f85 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153228 Jul 19 15:51:58.042647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 657/1299] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:57 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:59.060076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:59.060685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:59.066864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:59.067307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:59.068063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:59.068498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:59.194715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:59.203067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d16f35cd-f60e-42ef-9c0a-8b0289c8046e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147363 Jul 19 15:51:59.203654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 643/1300] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:59 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:00.219825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:00.220548 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:00.227071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:00.227516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:00.228335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:00.229427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:00.360576 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:00.368356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e94b8be8-6466-43c6-bd71-0ed469b214e9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152448 Jul 19 15:52:00.368909 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 658/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:00 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:01.385808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:01.386394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:01.393668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:01.394110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:01.394864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:01.395292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:01.528364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:01.536275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8e946e92-b6c2-4cc4-b58b-58ced5819e72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154382 Jul 19 15:52:01.536827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 644/1302] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:02.553493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:02.554099 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:02.561936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:02.562382 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:02.563145 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:02.563578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:02.696342 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:02.705015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c9baed7d-9a4c-4dd9-b67c-4599db43d653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155499 Jul 19 15:52:02.705618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 659/1303] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:02 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:03.722057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:03.722682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:03.729130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:03.729598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:03.730349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:03.730773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:03.861532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:03.869277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea6dc39a-76d6-4684-8a6f-8b2ba7b69b72 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151063 Jul 19 15:52:03.869828 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 645/1304] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:04.886500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:04.887056 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:04.893775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:04.894228 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:04.894989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:04.895423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:05.023521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:05.032178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f83820d6-cba5-4b05-9ef7-897f5df2b653 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149608 Jul 19 15:52:05.032736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 660/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:04 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:06.049717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:06.050276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:06.056661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.057099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.057888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.058321 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.188633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:06.196422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-16946558-1f92-4362-aa4c-c5738939fd8b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150631 Jul 19 15:52:06.196978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 646/1306] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:06 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:07.212704 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:07.213278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:07.219816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.220260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.221011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.221466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.348847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:07.357220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f0803d49-0957-4df7-ac7d-fa00635439d0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148418 Jul 19 15:52:07.357784 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 661/1307] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:07 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:08.374262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:08.375545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:08.382024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.382467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.383218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.383643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.509242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:08.517451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cd39869a-1860-4482-833a-6bfccded1db1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147092 Jul 19 15:52:08.517998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 647/1308] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:09.535245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:09.535803 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:09.546499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:09.546966 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:09.547746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:09.548184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:09.691854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:09.701026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-869818ab-487c-4570-abe2-9246b1c3a307 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.170299 Jul 19 15:52:09.701635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 662/1309] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:09 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:10.729125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:10.729763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:10.736743 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:10.737217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:10.737970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:10.738400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:10.864554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:10.872607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-681656d4-6b7e-45a6-b9bc-a7249ac1d422 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151367 Jul 19 15:52:10.873173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 648/1310] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:11.889374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:11.889980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:11.896820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:11.897312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:11.898080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:11.898520 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:12.026993 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:12.035165 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-003078c6-d31d-4234-a25e-d98e48612690 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149704 Jul 19 15:52:12.035726 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 663/1311] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:11 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:12.880618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:52:12.881180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:52:13.052294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:13.052909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:13.060880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:13.061362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:13.062163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:13.062605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:13.193726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:13.202327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b19822b2-be86-4b69-b9db-124e064f867b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154584 Jul 19 15:52:13.202872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 649/1312] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:13 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:13.621563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:52:13.622109 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:52:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:52:14.219922 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:14.220522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:14.227053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:14.227504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:14.228272 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:14.228712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:14.360629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:14.368735 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-29d3d8d4-dec5-427e-8a2b-72b7153026eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153498 Jul 19 15:52:14.369341 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 664/1313] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:14 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:15.386296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:15.386921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:15.393610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.394053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.394808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.395238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.527957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:15.535790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f7a413e-5f04-478e-a0e8-dcbbd42b42d8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153467 Jul 19 15:52:15.536345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 650/1314] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:15 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:52:16.553098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:16.553736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:16.560280 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.560731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.561531 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.561969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.687745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:16.695580 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-32cf2fed-fe4f-4bae-a2bb-2a9633a96f33 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146344 Jul 19 15:52:16.696136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 665/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:17.713670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:17.714228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:17.721260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:17.721702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:17.722455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:17.722883 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:17.854133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:17.862006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9e09ab4a-ea16-44cc-b4d2-080c13de9358 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152235 Jul 19 15:52:17.862585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 651/1316] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:18.878905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:18.879503 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:18.885916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:18.886353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:18.887742 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:18.888169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:19.014230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:19.022288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a11ba0d3-d514-4834-a934-4f6b4cb4b957 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147247 Jul 19 15:52:19.022839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 666/1317] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:18 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:20.038552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:20.039158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:20.046156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:20.046598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:20.047377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:20.047785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:20.177853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:20.185856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bcc0b2b5-bdf6-42fa-b48b-5de8d88b3ca9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151186 Jul 19 15:52:20.186410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 652/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:21.202913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:21.203528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:21.210111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:21.210584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:21.211353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:21.211789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:21.338596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:21.349889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-96260eb8-336a-46cc-80fe-afa12446ecda tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150720 Jul 19 15:52:21.350730 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 667/1319] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:21 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:22.373473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:22.374072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:22.380556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:22.380996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:22.381871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:22.382306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:22.560862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:22.568725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e491b52d-350f-4929-84ca-aa69639b7208 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.199822 Jul 19 15:52:22.569302 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 653/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:22 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:23.585926 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.586466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:23.593012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.593486 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.594248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.594683 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.724287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:23.733279 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5dbbec15-3409-4a6a-a463-7b6f68310991 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150986 Jul 19 15:52:23.733859 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 668/1321] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:24.750168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:24.750765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:24.757233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:24.757674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:24.758426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:24.758867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:24.885945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:24.895227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2e60741b-7ab3-4b5a-804e-d21efe83dcd7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148953 Jul 19 15:52:24.895777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 654/1322] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:25.912251 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:25.912847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:25.919896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:25.920439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:25.921223 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:25.921655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.050846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:26.058662 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3efddaaa-fd18-4054-8da6-182316151cac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150241 Jul 19 15:52:26.059385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 669/1323] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:25 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:27.075301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.075869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:27.078172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=26 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:27.084069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.084512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.085310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.085738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.089652 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=78 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:27.214068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:27.222401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-93a7ab42-c189-44cb-a88d-091148fbefc3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151441 Jul 19 15:52:27.222955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 655/1324] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:27 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:28.240233 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.240840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:28.242711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=26 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:28.248885 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.249346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.250114 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.250538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.253363 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=78 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:28.382681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:28.390783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f8832e95-e8d5-4ec6-8c27-ddb688441947 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154551 Jul 19 15:52:28.391347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 670/1325] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:29.408502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:29.409108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:29.415182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.415638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.416403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.416841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.788029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:29.796441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c4ec87be-af46-4d3e-8189-1d2cacb94230 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.392566 Jul 19 15:52:29.796999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 656/1326] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:29 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:30.814061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:30.814595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:30.821130 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:30.821598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:30.822351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:30.822786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:30.947721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:30.956119 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-154a2f9d-2f4a-4014-9912-0c6858ff0f78 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146633 Jul 19 15:52:30.956681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 671/1327] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:30 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:31.973934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:31.974536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:31.981037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.981518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.982312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.982742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:32.116888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:32.124941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-41835590-c0af-422b-94a7-35ae21a96827 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154962 Jul 19 15:52:32.125528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 657/1328] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:33.142146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:33.142816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:33.149401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.149847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.150618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.151050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.281942 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:33.289777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0a16be12-6a9c-4a66-ac6a-4e4298328d42 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151858 Jul 19 15:52:33.290345 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 672/1329] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:33 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:34.307021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:34.307635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:34.314832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.315282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.316045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.316479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.450153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:34.458350 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d29771e3-fb1d-4ad7-8380-0207ae95e57f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155178 Jul 19 15:52:34.458922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 658/1330] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:35.475406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:35.476013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:35.482557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:35.482998 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:35.483760 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:35.484188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:35.507685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:52:35.509833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Tue Jul 19 15:52:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc (ip 10.222.0.42) !!! Jul 19 15:52:35.611566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:35.619418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-78f6945e-01b4-4e9b-824f-864360235cfe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147935 Jul 19 15:52:35.620167 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 673/1331] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:36.637650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:36.638246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:36.646921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:36.647356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:36.648106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:36.648527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:36.780962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:36.790018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bc8a4817-be7e-448a-becb-94d308b7b96e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156144 Jul 19 15:52:36.790508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 659/1332] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:36 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:37.807356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:37.807956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:37.814500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.814943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.815711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.816148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.941927 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:37.949678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a7fae721-7cb5-44e3-975a-3d643bf31019 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146207 Jul 19 15:52:37.950239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 674/1333] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:38.967424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:38.967993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:38.974910 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:38.975353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:38.976110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:38.976543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:39.106303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:39.114759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-32ff1a66-43ed-4603-b8db-2ed20fed599b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151265 Jul 19 15:52:39.115332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 660/1334] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:40.133151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:40.133781 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:40.140199 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:40.140647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:40.142264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:40.142702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:40.272719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:40.280491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-58439145-7bc9-43f8-ba1b-d361f2dba7c4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152331 Jul 19 15:52:40.281051 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 675/1335] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:40 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:41.298308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:41.299048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:41.306265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:41.306709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:41.307466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:41.307917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:41.524182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:41.534696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f7c9fb2-9611-499d-8546-e7d6c430584d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.240223 Jul 19 15:52:41.535328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 661/1336] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:42.551699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:42.552300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:42.558688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:42.559125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:42.559878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:42.560303 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:42.698753 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:42.707335 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3510e9e5-0d63-4da4-8527-c7f09ab106f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159468 Jul 19 15:52:42.707893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 676/1337] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:43.723695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:43.724337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:43.730894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:43.731339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:43.732130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:43.732563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:43.859524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:43.867804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a1d08c5a-173b-4320-82fd-45eddb61794d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147985 Jul 19 15:52:43.868353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 662/1338] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:43 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:44.884724 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:44.885313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:44.891953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:44.892391 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:44.893180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:44.893825 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:45.025697 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:45.033538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8650daa9-71c5-48f4-9c7f-aef9be9d8b23 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152668 Jul 19 15:52:45.034646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 677/1339] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:46.051068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:46.051661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:46.058100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:46.058548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:46.059295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:46.059721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:46.187368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:46.195858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-248300cf-3108-42a9-8941-d7e083c0a256 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148655 Jul 19 15:52:46.196424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 663/1340] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:47.212815 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:47.213455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:47.220542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:47.220981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:47.222318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:47.222746 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:47.350020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:47.357976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-36aa23e5-46db-474d-b3f6-f9d39badda59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149075 Jul 19 15:52:47.358537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 678/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:48.375812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:48.376409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:48.383950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:48.384408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:48.385239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:48.385665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:48.518880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:48.526692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3987dfb2-b027-4859-8732-4264a079c540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154799 Jul 19 15:52:48.527252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 664/1342] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:48 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:49.544254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:49.544806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:49.551472 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:49.551916 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:49.552684 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:49.553121 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:49.682077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:49.691107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-32df75bb-49cb-4e3b-9fbf-7f7879b358de tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150725 Jul 19 15:52:49.691692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 679/1343] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:50.709243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:50.709873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:50.716385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:50.716825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:50.717602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:50.718027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:50.845740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:50.853727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e4ce6fc2-b12b-4bc6-817d-98748c8a1dc6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148438 Jul 19 15:52:50.854284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 665/1344] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:50 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:51.871563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:51.872206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:51.879368 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:51.879812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:51.880557 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:51.880987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:52.009616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:52.017792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6cb9089d-6914-4814-8d49-0333acb2e53e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150073 Jul 19 15:52:52.019011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 680/1345] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:51 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:53.035754 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:53.036361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:53.042829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:53.043269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:53.044022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:53.044450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:53.176440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:53.184650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-578f2756-6d79-4ffd-8bf3-ae9dd1954cc5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152781 Jul 19 15:52:53.185244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 666/1346] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:53 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:54.202854 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:54.203418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:54.209873 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:54.210325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:54.211355 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:54.211785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:54.345234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:54.353759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-82231e2e-fc3b-4b7f-a410-0c66bb4f348e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154880 Jul 19 15:52:54.354318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 681/1347] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:55.372097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:55.372705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:55.379991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:55.380447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:55.381248 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:55.381692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:55.507552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:55.515384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-497f4543-78f4-4902-9be5-854b15ad0f27 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147263 Jul 19 15:52:55.515942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 667/1348] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:55 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:56.532833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:56.533414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:56.540389 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:56.540834 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:56.541628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:56.542066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:56.671681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:56.679599 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9bd66e07-1a0c-46ca-b543-cc74853a6f62 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150668 Jul 19 15:52:56.680165 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 682/1349] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:57.696543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:57.697082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:57.699380 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=26 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:57.704643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:57.705094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:57.705874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:57.706521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:57.709287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=78 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:57.834535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:57.842347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cb670b87-2b6a-46f1-a624-8f0875b45e91 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149773 Jul 19 15:52:57.842899 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 668/1350] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:57 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:58.859354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:58.859893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:58.862007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=26 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:58.867499 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:58.867974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:58.868727 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:58.869209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:58.873209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=78 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:58.999422 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:59.007400 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c088245e-4569-4fb3-9648-a91104454f64 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151984 Jul 19 15:52:59.007955 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 683/1351] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:58 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:00.025102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:00.025737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:00.032063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:00.032510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:00.033315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:00.033753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:00.158362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:00.166900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9986a824-f3b7-4e47-84e7-11741830da1a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145761 Jul 19 15:53:00.167466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 669/1352] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:00 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:01.184435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:01.185045 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:01.192637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:01.193084 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:01.193876 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:01.194308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:01.324143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:01.331968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4ece2f93-a0d7-4283-b016-bfbf7df1ef94 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151368 Jul 19 15:53:01.332522 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 684/1353] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:02.348973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:02.349614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:02.356056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:02.356500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:02.357288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:02.357720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:02.490010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:02.497874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1b111026-aaae-4634-bf5b-18dd561ed923 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152885 Jul 19 15:53:02.498447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 670/1354] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:02 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:03.515431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:03.515945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:03.523095 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:03.523537 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:03.524286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:03.524710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:03.649839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:03.657733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-84b5a149-d017-44cb-a6ef-fab973792f61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146188 Jul 19 15:53:03.658294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 685/1355] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:04.676235 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:04.676844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:04.683379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:04.683821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:04.684577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:04.685010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:04.820065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:04.828006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-68c9fa7a-e874-4f0d-8d4f-6ccaf8cc2b51 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156251 Jul 19 15:53:04.828567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 671/1356] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:04 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:05.845023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:05.845847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:05.852762 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:05.853339 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:05.854202 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:05.854710 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:05.989243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:05.997251 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3f1bde0e-75ea-42b2-b39f-8f35bd93f1c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156012 Jul 19 15:53:05.997820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 686/1357] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:05 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:07.014701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:07.015299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:07.022877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:07.023316 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:07.024069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:07.024494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:07.157068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:07.165921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-31d4b887-1cb6-4013-8598-dcabec987a12 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155051 Jul 19 15:53:07.166485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 672/1358] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:07 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:08.183085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:08.183638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:08.190101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:08.190690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:08.191468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:08.191913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:08.322137 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:08.329828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-587580c4-5096-45c8-9a16-06a29766ac84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150697 Jul 19 15:53:08.330388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 687/1359] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:09.347587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:09.348185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:09.354941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:09.355384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:09.356142 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:09.356568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:09.480613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:09.488616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f90c2938-2d3e-4658-bce7-f5c57379c6b9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145606 Jul 19 15:53:09.489193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 673/1360] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:09 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:10.506023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:10.506582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:10.513275 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:10.513732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:10.514514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:10.514983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:10.666882 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:10.675004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-26b2cfa6-4616-40ed-b7f0-f2c126b3cf74 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.173578 Jul 19 15:53:10.675585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 688/1361] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:11.694785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:11.695400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:11.702218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:11.702655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:11.703414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:11.703844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:11.830138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:11.838662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e6b39d0d-44c4-448b-86f3-9c35e06cb5f3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147740 Jul 19 15:53:11.839230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 674/1362] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:11 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:12.856089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:12.856619 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:12.863052 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:12.863493 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:12.864245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:12.865326 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:12.994166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:13.006016 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8a2371ca-de3e-4a53-86ba-00542e520c29 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153802 Jul 19 15:53:13.006581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 689/1363] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:12 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:14.023084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:14.023671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:14.030082 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:14.030523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:14.031277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:14.031702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:14.158771 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:14.167281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bf6debd7-06ae-4ee2-92b2-eb91b6ff5896 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148204 Jul 19 15:53:14.167844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 675/1364] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:14 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:15.184144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:15.184748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:15.191216 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:15.191656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:15.192406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:15.193376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:15.324875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:15.332738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d4658f21-124e-4c46-bddd-5ab23f37d29f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152450 Jul 19 15:53:15.333348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 690/1365] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:15 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:16.350319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:16.350908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:16.357311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:16.357753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:16.358503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:16.358933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:16.489093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:16.497841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ebb7e65-0bb6-4d9a-8eac-65ed21e68180 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151852 Jul 19 15:53:16.498391 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 676/1366] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:17.514956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:17.515501 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:17.522243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:17.522694 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:17.523468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:17.523905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:17.649318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:17.657177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ab589bf0-292d-49fe-b11b-d36e174727ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146121 Jul 19 15:53:17.657729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 691/1367] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:18.674440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:18.675043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:18.682247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:18.682695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:18.683456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:18.683888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:18.814334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:18.822774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea6a6a55-6c2d-4569-8ff3-1d26193a8cb5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152229 Jul 19 15:53:18.823343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 677/1368] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:18 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:19.840160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:19.840764 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:19.847252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:19.847699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:19.848456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:19.850081 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:19.978333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:19.986210 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-18c892b1-c983-427b-a1e5-1cc70a565411 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149915 Jul 19 15:53:19.986771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 692/1369] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:19 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:21.003441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:21.004049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:21.010633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:21.011081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:21.011849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:21.012286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:21.143897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:21.152204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-23f0364a-2f4c-40af-b3ca-be8fd8c5590a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152649 Jul 19 15:53:21.152778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 678/1370] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:22.170215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:22.170824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:22.178424 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.178870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.179634 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.180066 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.308105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:22.315936 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6ecd596c-00c1-4a9f-aa8c-61d70fcb2b1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149622 Jul 19 15:53:22.316489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 693/1371] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:22 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:22.657364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:22.657906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:22.665439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.665879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.666631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.667056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.695947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Going to try to terminate instance {{(pid=118007) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:53:22.774138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-706f6078-627a-4fb1-871f-5f86dab91484 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 204 len: 0 microversion: 2.1 time: 0.120361 Jul 19 15:53:22.774726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 679/1372] 10.222.0.42 () {58 vars in 1238 bytes} [Tue Jul 19 15:53:22 2022] DELETE /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:53:22.783865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:22.784468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:22.791265 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.791705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.792462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:22.792889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.922598 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:22.930576 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c94dda86-7ee8-4223-8046-c637d52598c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1601 microversion: 2.1 time: 0.150692 Jul 19 15:53:22.931143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 694/1373] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:23.335748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:23.336470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:23.342684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.343129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.343900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.344335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.578935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:23.587069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d407cbda-f27f-4479-b419-dee756eb0e83 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.256750 Jul 19 15:53:23.587645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 680/1374] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:23.918801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [req-7e8762e6-b87e-4ea9-b33f-92da6c112990 req-236d26c9-f7a6-4836-b7ea-3ba78759d80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf", "name": "network-vif-deleted", "tag": "aeb27489-0829-4e36-8f5c-a718f63aa2a0"}]} {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:23.927639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7e8762e6-b87e-4ea9-b33f-92da6c112990 req-236d26c9-f7a6-4836-b7ea-3ba78759d80e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.928072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [req-7e8762e6-b87e-4ea9-b33f-92da6c112990 req-236d26c9-f7a6-4836-b7ea-3ba78759d80e service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.938789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.compute.server_external_events [req-7e8762e6-b87e-4ea9-b33f-92da6c112990 req-236d26c9-f7a6-4836-b7ea-3ba78759d80e service nova] Creating event network-vif-deleted:aeb27489-0829-4e36-8f5c-a718f63aa2a0 for instance 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf on hv-cinder-84984 Jul 19 15:53:23.944821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [req-7e8762e6-b87e-4ea9-b33f-92da6c112990 req-236d26c9-f7a6-4836-b7ea-3ba78759d80e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097128 Jul 19 15:53:23.945435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 695/1375] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:23.951407 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:23.952338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:23.962698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.963152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.964001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.964445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:24.030763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:24.039335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d2854bb0-0186-42b1-910d-3f86db7fc60f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.094439 Jul 19 15:53:24.039902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 681/1376] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:24.605188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:24.605889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:24.612101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:24.612560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:24.613358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:24.613797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:24.740807 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:24.748707 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eaa096b2-3d60-4268-a53c-f5ea6ad4167e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147849 Jul 19 15:53:24.749289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 696/1377] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:25.057405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:25.058042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:25.064863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.065346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:25.066115 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.066552 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:25.126815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:25.135796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7c4eeb04-a7fc-4edb-8184-a258f8d23419 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082276 Jul 19 15:53:25.136360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 682/1378] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:25.766852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:25.767454 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:25.774500 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.774953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:25.775721 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.776157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:25.908675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:25.917468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d308aff9-1eb8-40ce-ae06-f09e0949daf2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154830 Jul 19 15:53:25.918041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 697/1379] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:25 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:26.152819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:26.153480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:26.159981 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:26.160422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:26.161225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:26.161666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:26.164291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:26.226150 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:26.234285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-474afe07-47dd-4ce3-b839-8cf456e3b1c8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085313 Jul 19 15:53:26.234842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 683/1380] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:26.935702 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:26.936278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:26.943337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:26.943792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:26.944569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:26.945010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.082169 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:27.090540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ae62d468-e8b8-4ed0-8a85-31354250b7a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159091 Jul 19 15:53:27.091132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 698/1381] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:27.251343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:27.251976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:27.259276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:27.259705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.260474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:27.260914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.330034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:27.338061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9638111a-4b81-4ce4-bf3d-803fd2ec1eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.090672 Jul 19 15:53:27.338625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 684/1382] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:28.108286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:28.108950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:28.115841 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.116276 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.117026 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.117488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.251649 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:28.260655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e3c7451b-1750-4cfc-a850-cb91ea66b588 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156533 Jul 19 15:53:28.261301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 699/1383] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:28.355487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:28.356172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:28.358451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:28.363649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.364671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.365578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.366014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.431884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:28.439924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7c1134f2-92e7-417f-aaa5-1a0b8dba3ccf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.088326 Jul 19 15:53:28.440486 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 685/1384] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:29.279143 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:29.279744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:29.282122 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=34 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:29.287805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.288255 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.289021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.289485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.293336 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=98 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:29.434025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:29.443003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21fab182-99c4-461a-8dd9-92cd78f27b47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.167257 Jul 19 15:53:29.443584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 700/1385] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:29 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:29.456960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:29.457627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:29.464921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.465403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.466170 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.466605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.529543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:29.537513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2af7e0ac-d657-475b-9895-dd178872d69b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084570 Jul 19 15:53:29.538068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 686/1386] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:30.460566 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:30.461297 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:30.469971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.470565 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.471618 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.472178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.554930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:30.555998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:30.561976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.562419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.563177 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.563611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.650413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:30.653014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:30.659071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9106c8c6-64f2-4496-9e8d-dd9e6b4f07c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.202894 Jul 19 15:53:30.659636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 701/1387] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:30 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:30.660740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b3a0a1c7-8cc0-421f-be9d-07a60e232328 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.109798 Jul 19 15:53:30.661315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 687/1388] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:31.678010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:31.678656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:31.685200 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:31.685651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:31.686418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:31.686848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:31.747885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:31.748568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:31.751837 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:31.754701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:31.755244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:31.756027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:31.756464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:31.760107 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-41b57450-ff95-4d0e-909e-0cfc1b02c515 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086640 Jul 19 15:53:31.760685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 702/1389] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:31.892947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:31.901713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b9d4a682-0e7f-4e5d-88a5-abaaf3a6a1dc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.226950 Jul 19 15:53:31.902277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 688/1390] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:32.777059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:32.777679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:32.784299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.784747 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.785546 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.786178 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.850473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:32.858420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-09b2fc69-f5a4-4685-afa5-2c06d1f0b3e7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085345 Jul 19 15:53:32.858981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 703/1391] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:32.920245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:32.920896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:32.929732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.930190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.930965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.931397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.066850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:33.076127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-73d8a237-761a-4554-8af3-d10a5e5bc6aa tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159876 Jul 19 15:53:33.077009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 689/1392] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:32 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:33.877249 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:33.877858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:33.885105 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.885581 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.886378 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.886816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.953290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:33.962776 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c226d74e-1d05-41a2-8573-fcd5ba177b13 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.089415 Jul 19 15:53:33.963395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 704/1393] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:34.099056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:34.099685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:34.106130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.106570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.107388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.108040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.236734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:34.245673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-489d85db-ce34-4258-82e4-369f126cc657 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150445 Jul 19 15:53:34.246241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 690/1394] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:34.980475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:34.981207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:34.987612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.988061 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.988868 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.989502 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.053085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:35.061327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ba00aa2d-0432-419a-be43-8e07c4f3b046 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084498 Jul 19 15:53:35.061885 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 705/1395] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:35.263797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:35.264403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:35.272500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.272948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.273756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.274186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.410251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:35.419402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b46eec3d-48db-4ad8-b9b0-fdbb2b154840 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159716 Jul 19 15:53:35.419965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 691/1396] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:36.078864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:36.079475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:36.086185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:36.086637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:36.087449 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:36.087847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:36.147321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:36.155153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0bac88e6-0c0b-4ecd-b576-92ecc4208876 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080221 Jul 19 15:53:36.155712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 706/1397] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:36.435774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:36.436402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:36.442818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:36.443256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:36.444012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:36.444441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:36.579811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:36.587887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4c9378ab-e1c6-4a82-9a9f-6275bc41c17d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155971 Jul 19 15:53:36.588523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 692/1398] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:36 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:37.171705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:37.172318 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:37.178940 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.179388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.180148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.180587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.240213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:37.248327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-593aafd4-df6c-45cf-9416-f782bf4ed76b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080515 Jul 19 15:53:37.248893 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 707/1399] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:37.605567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:37.606253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:37.612805 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.613295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.614360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.614802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.741025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:37.748872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e855097c-1187-4132-9704-31f59cab3293 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147554 Jul 19 15:53:37.749462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 693/1400] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:38.265175 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:38.266040 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:38.272738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.273213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.273983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.274419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.336971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:38.344850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-52174012-42aa-47dd-8724-9c7a7691f302 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083546 Jul 19 15:53:38.345443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 708/1401] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:38.767408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:38.768031 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:38.775026 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.775466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.776223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.776648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.904529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:38.912440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1cc04d76-b960-40a5-8930-30600c5f5d4c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149168 Jul 19 15:53:38.913006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 694/1402] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:39.362300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:39.362911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:39.369915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.370364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.371133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.371569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.433870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:39.442441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-33257a77-1cc9-4212-b302-e92b908a9873 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083388 Jul 19 15:53:39.443004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 709/1403] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:39.930007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:39.930614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:39.937019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.937494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.938254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.938693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.072152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:40.080002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-be716a1c-698a-4f8d-b56e-154dee51d842 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154532 Jul 19 15:53:40.080779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 695/1404] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:39 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:40.459999 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:40.460637 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:40.467315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.467761 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.468527 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.468961 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.529118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:40.537053 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-48c0c5fc-2e25-45ad-b300-4b792694f483 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081622 Jul 19 15:53:40.537627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 710/1405] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:41.098429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:41.099346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:41.105543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.105991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:41.106748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.107183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:41.231336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:41.240430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cb985958-e762-4df6-9c63-d009afcbc536 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146429 Jul 19 15:53:41.241008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 696/1406] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:41.554156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:41.554766 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:41.561248 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.561701 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:41.562464 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.562896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:41.626666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:41.635245 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-463a7758-13a2-415c-ab20-565c3a924fcb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085387 Jul 19 15:53:41.635800 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 711/1407] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:42.257987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:42.258584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:42.264985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.265464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.266484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.266909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.391405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:42.399258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4bdf2ac7-c0b5-4649-a489-a564c7a3d2a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145756 Jul 19 15:53:42.399816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 697/1408] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:42.651861 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:42.652467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:42.658944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.659388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.660144 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.661180 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.724705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:42.732528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7765b372-f663-44f3-a1d3-6708327754ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084531 Jul 19 15:53:42.733088 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 712/1409] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:43.416431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:43.417032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:43.423559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.423998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.424742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.425191 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.556257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:43.564054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6a42b539-b60c-4028-a11e-e4c182a61cbe tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151494 Jul 19 15:53:43.564614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 698/1410] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:43 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:43.750002 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:43.750609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:43.758370 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.758759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.759524 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.759956 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.820179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:43.827977 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0b82731e-18cf-497c-8053-db94e7fbc0cc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081805 Jul 19 15:53:43.828529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 713/1411] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:44.581890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:44.583084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:44.589645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.591063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.591847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.592284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.718072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:44.720285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:44.728435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f13e1b32-dac3-4ae9-b29c-c31f03027c7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150568 Jul 19 15:53:44.729002 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 699/1412] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:44.845007 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:44.845629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:44.852599 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.853042 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.853842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.854275 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.917332 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:44.925168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-66eb6674-afbf-44ea-b818-f7da7d47399e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084053 Jul 19 15:53:44.925731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 714/1413] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:45.747200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:45.747868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:45.754513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.754966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.755731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.756164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.881735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:45.889551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-69de642e-54f0-4b18-919d-856d8dcc122a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146191 Jul 19 15:53:45.890291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 700/1414] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:45.941751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:45.942413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:45.948656 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.949102 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.949896 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.950333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:46.009547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:46.017636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-52067bf3-8e3e-445b-b9af-adc2591c3401 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079760 Jul 19 15:53:46.018197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 715/1415] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:46.906439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:46.907027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:46.913768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:46.914209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:46.914969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:46.915404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.034816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.035627 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:47.042098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.042540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.043301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.043732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.044156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:47.052821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e754ecf0-8945-47c4-af9b-7bccbd20b6bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150288 Jul 19 15:53:47.053432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 701/1416] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:47.104553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:47.106759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:47.114917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f83348bb-1340-4be3-b04d-bbbee8694be3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083853 Jul 19 15:53:47.115489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 716/1417] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:48.070597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:48.071204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:48.077751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.078200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.078963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.079399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.133379 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:48.133990 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:48.140592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.141409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.142184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.142621 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.218217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:48.226260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5d841645-8a99-41e7-85b3-55bf9bbd8c2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.097259 Jul 19 15:53:48.227023 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 717/1418] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:48.234510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:48.243143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2ff181cb-1d32-45d8-a483-75e7d2d4db25 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.176940 Jul 19 15:53:48.243722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 702/1419] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:48 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:49.243538 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:49.244150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:49.250693 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.251140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.251908 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.252339 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.260275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:49.260877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:49.267055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.267494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.268251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.268680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.316211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:49.325392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e9e2980a-f389-40bf-b168-a8c1ef9dcde9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085827 Jul 19 15:53:49.325972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 718/1420] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:49.409194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:49.416990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2e5e6ecf-71b0-4c50-9faf-b70fb0a79028 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.161180 Jul 19 15:53:49.417578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 703/1421] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:50.434252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.434935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.441246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.441688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.442675 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.443101 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.453622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.454258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.460811 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.461277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.462038 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.462466 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.541094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:50.548976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f965a0dd-583e-4773-9f26-188b6be45b9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.209887 Jul 19 15:53:50.549574 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 719/1422] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:50.598037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:50.606625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6a56c34f-85f2-42ed-95a7-acd14b1dfc6b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.176501 Jul 19 15:53:50.607187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 704/1423] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:51.566754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:51.568504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:51.574514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.574953 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.575734 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.576160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.623671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:51.624279 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:51.630628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.631072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.631836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.632265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.636338 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:51.644455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-cb2cb438-75f0-457d-8399-5fdedc9dd2a1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081602 Jul 19 15:53:51.645028 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 720/1424] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:51.998511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:52.006522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-33d29bc0-6a08-4de6-877c-bd4f74cd6a2d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.386676 Jul 19 15:53:52.007084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 705/1425] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:51 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:52.661783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:52.662387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:52.668809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:52.669286 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:52.670055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:52.670489 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:52.733587 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:52.747366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-901ae5e0-3304-4f04-9699-883f65e07ff5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.089297 Jul 19 15:53:52.747944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 721/1426] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:53.022930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:53.023527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:53.029989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.030429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.031178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.031603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.155829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:53.164138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-29b54b0c-078b-485a-9c53-d686feb53e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145049 Jul 19 15:53:53.164695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 706/1427] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:53 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:53.764740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:53.765357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:53.772571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.773011 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.773857 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.774288 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.839635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:53.847583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f432b0dc-eb10-4f69-ae13-f6d0eab0091d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086619 Jul 19 15:53:53.848159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 722/1428] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:54.181202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:54.181758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:54.188307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.188746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.189528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.189955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.318313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:54.326215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1e0614e0-242d-4533-9325-c09ede8ccbca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148978 Jul 19 15:53:54.327078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 707/1429] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:54.551836 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:53:54.552128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:53:54.865630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:54.866192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:54.872571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.873020 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.873824 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.874262 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.935774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:54.943654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a107d1be-029e-4f11-a01d-95830f65b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082817 Jul 19 15:53:54.944212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 723/1430] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:55.343217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:55.343827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:55.351049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.351500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:55.352266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.352701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:55.480017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:55.487888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-54e8fb7e-da39-4a57-a523-2ea1fd93f82d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148545 Jul 19 15:53:55.488451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 708/1431] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:55 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:55.960157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:55.960749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:55.967136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.967580 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:55.968333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.968788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:56.028532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:56.037517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8b66243d-42bd-45a8-a86b-ac4addecf719 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081730 Jul 19 15:53:56.038078 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 724/1432] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:56.506525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:56.507095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:56.513601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:56.514042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:56.514798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:56.515224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:56.641189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:56.648958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-32ab3ec2-4172-4d2d-8539-ed8d5ce36eb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147135 Jul 19 15:53:56.649544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 709/1433] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:57.055206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:57.055838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:57.062300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.062771 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.063532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.063964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.127347 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:57.135528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-67316e55-e331-4b99-9687-e4c0ce8b03f0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085100 Jul 19 15:53:57.136090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 725/1434] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:57.666567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:57.667168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:57.673606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.674045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.674795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.675223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.800749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:57.809457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-deea6f1f-d7ee-44ab-ad1f-e3897d17f6e7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146665 Jul 19 15:53:57.810045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 710/1435] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:57 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:58.152984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:58.153613 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:58.159713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.160157 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.161674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.162114 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.221259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:58.230090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-558e5f91-524d-4a94-9edb-a331904a8798 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081105 Jul 19 15:53:58.230641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 726/1436] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:58.826762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:58.827499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:58.833611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:58.839185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.839625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.840392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.840817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.970132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:58.977969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d4fa30ee-5d0d-433e-9422-2e93583dd96a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155195 Jul 19 15:53:58.978517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 711/1437] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:58 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:59.247136 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:59.247813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:59.254739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:59.255183 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:59.255943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:59.256369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:59.317516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:59.325393 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a735960e-ff42-4616-9b98-43f9672099c9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082088 Jul 19 15:53:59.325946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 727/1438] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:59.995527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:59.996183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:00.002622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.003059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:00.003807 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.004353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:00.130067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:00.137938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-39d92d8f-c0b3-406e-87e1-d9971c9744a0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146285 Jul 19 15:54:00.138489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 712/1439] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:59 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:00.343793 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:00.344411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:00.346641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=56 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:00.352595 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.353057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:00.353839 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.354268 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:00.418750 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:00.426831 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d51409e2-b0b4-4cfe-b043-e991acd4ad2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086750 Jul 19 15:54:00.427382 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 728/1440] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:01.155341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:01.155943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:01.162731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:01.163178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:01.163937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:01.164368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:01.293161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:01.301551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9bfb3e3f-39e2-4d6b-a2d6-d14f67908ac9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149599 Jul 19 15:54:01.302163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 713/1441] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:01.443671 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:01.444188 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:01.450571 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:01.451012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:01.451765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:01.452192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:01.511552 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:01.519677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21c02fa9-2559-4673-b727-94299090c10e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079895 Jul 19 15:54:01.520377 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 729/1442] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:02.319093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:02.319728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:02.326256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.326704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.327468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.327904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.456442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:02.464925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fefe7e2d-635e-4710-aabe-a143a434cebb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150273 Jul 19 15:54:02.465512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 714/1443] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:02 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:02.537122 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:02.537890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:02.544140 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.544588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.545387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.545822 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.605462 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:02.613305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c3fa4f8d-d207-4cdc-8299-f9eee933663f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080099 Jul 19 15:54:02.614658 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 730/1444] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:03.481940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:03.482542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:03.488955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.489431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.490183 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.490612 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.616303 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:03.624146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-db52764c-f917-48b6-9c89-cb2fd270318a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146028 Jul 19 15:54:03.624865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 715/1445] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:03.631278 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:03.631890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:03.638348 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.638800 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.639570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.640009 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.703675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:03.712287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d061cbf2-a8fc-4e87-b543-1512637d99c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085336 Jul 19 15:54:03.712842 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 731/1446] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:04.642100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:04.642699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:04.649544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.650007 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.650759 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.651186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.666051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:04.729939 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:04.730636 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:04.737098 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.737560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.738385 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.738846 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.792951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:04.800958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dd13f384-ae02-43ec-b601-fe68a847c056 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.162983 Jul 19 15:54:04.801624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 716/1447] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:04 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:04.808931 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:04.816870 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-acd7df34-dc29-44b2-ba37-8498beb8c329 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.090892 Jul 19 15:54:04.817568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 732/1448] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:05.818660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:05.819288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:05.825806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.826247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.827014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.827423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.834080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:05.834689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:05.841055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.841532 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.842300 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.842729 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.858343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:05.925516 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:05.934427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6e0fe282-f340-4105-b49b-47a4cb5782c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.104555 Jul 19 15:54:05.934919 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 733/1449] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:05.983695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:05.992203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a402894d-dd70-46b8-b18e-4cee24336695 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.177988 Jul 19 15:54:05.992769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 717/1450] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:05 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:06.951197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:06.951758 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:06.958198 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:06.958646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:06.959412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:06.959851 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:07.008835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:07.009458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:07.016187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:07.016632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:07.017813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:07.017923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:07.020021 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:07.028138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a379d911-01fb-4b47-9ee6-fb5538ec22f8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080887 Jul 19 15:54:07.028698 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 734/1451] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:07.146087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:07.153975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0b3ddaf7-476c-42fc-b190-1236b1fe3e69 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149744 Jul 19 15:54:07.154542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 718/1452] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:07 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:08.045257 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:08.045968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:08.052409 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:08.052937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:08.053641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:08.054076 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:08.116362 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:08.124217 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c597724d-cf6b-4a66-bd84-c8b3a38a22bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082809 Jul 19 15:54:08.124769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 735/1453] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:08.170928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:08.171527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:08.178473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:08.178917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:08.179678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:08.180109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:08.309226 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:08.317096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2f7b277d-1e02-446a-bb20-351e1de68814 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149941 Jul 19 15:54:08.317693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 719/1454] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:09.142327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:09.142920 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:09.150008 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:09.150456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:09.151218 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:09.151679 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:09.215171 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:09.223438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-371cc491-200e-4273-a056-80f65d4d03e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084951 Jul 19 15:54:09.225132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 736/1455] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:09.335284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:09.335884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:09.342426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:09.342873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:09.343631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:09.344066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:09.475257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:09.483076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-81f9dd00-46c5-4eb3-b1d7-584f6881b315 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152206 Jul 19 15:54:09.483639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 720/1456] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:09 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:10.241864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:10.242491 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:10.248969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:10.249439 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:10.250208 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:10.250631 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:10.310905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:10.319238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2d61079f-1c38-4f2f-b808-21361cfb7d2f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081365 Jul 19 15:54:10.319789 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 737/1457] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:10.500342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:10.500898 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:10.507523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:10.507973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:10.508736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:10.509187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:10.638119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:10.646152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-31bc6a34-d5b9-4539-9129-0e3e7e8a3dff tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149706 Jul 19 15:54:10.647219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 721/1458] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:11.336427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:11.337031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:11.343583 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:11.344025 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:11.344774 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:11.345226 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:11.408765 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:11.417108 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-76a006b1-51f2-4668-ba57-13ad77137eeb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085126 Jul 19 15:54:11.417696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 738/1459] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:11.664385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:11.664959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:11.671378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:11.671828 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:11.672587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:11.673020 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:11.802450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:11.810946 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9037d1d8-3a21-4e2c-8031-9441b6fa224b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150600 Jul 19 15:54:11.811510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 722/1460] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:11 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:12.434843 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:12.435805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:12.443291 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:12.444435 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:12.445239 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:12.445675 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:12.514608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:12.523406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5950b0d6-36f7-4d54-b85d-49f0e318f341 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.093535 Jul 19 15:54:12.523979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 739/1461] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:12.827935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:12.828501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:12.836389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:12.836830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:12.837624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:12.838089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:12.990052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:12.998655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-62a1e339-00ef-4b30-bf11-7e55bb998c88 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.174644 Jul 19 15:54:12.999261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 723/1462] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:12 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:13.541556 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:13.542227 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:13.548688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:13.549129 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:13.549910 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:13.550337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:13.610313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:13.618235 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-41e9bc4e-6930-4111-9eb7-46ce9ef27648 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080791 Jul 19 15:54:13.618786 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 740/1463] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:14.016001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:14.016604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:14.023095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:14.023541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:14.024291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:14.024717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:14.152273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:14.160072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3417e04b-be7e-4941-8c01-dce5c6f10240 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148197 Jul 19 15:54:14.160628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 724/1464] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:14 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:14.634914 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:14.635513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:14.642168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:14.642606 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:14.643359 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:14.643787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:14.706540 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:14.715096 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-51517f58-5334-49cf-bd6b-d7d5e4187d4e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083988 Jul 19 15:54:14.715685 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 741/1465] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:15.178688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:15.179292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:15.185907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:15.186348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:15.187106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:15.187536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:15.316751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:15.325521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f525bb68-4d19-4358-92ab-41989e71f9f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151283 Jul 19 15:54:15.326081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 725/1466] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:15 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:15.732526 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:15.733146 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:15.739662 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:15.740817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:15.741616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:15.742050 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:15.800989 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:15.809554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-406d8c1a-49c9-4030-ba8f-d682bf1fec10 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081427 Jul 19 15:54:15.810147 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 742/1467] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:16.341822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:16.342420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:16.348834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:16.349305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:16.350288 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:16.350722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:16.479725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:16.488003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2246f643-9b47-475b-9fa8-4faaea7618ca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150044 Jul 19 15:54:16.488569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 726/1468] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:16.825874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:16.826517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:16.833015 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:16.833494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:16.834739 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:16.835176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:16.895945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:16.903924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-891891d8-9250-468b-becd-72fa40901f85 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081882 Jul 19 15:54:16.904485 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 743/1469] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:17.505529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:17.506376 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:17.513227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:17.513673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:17.514435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:17.514858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:17.641998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:17.650706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d43b08dc-57ff-4fce-acab-12441373dd3c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149140 Jul 19 15:54:17.651266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 727/1470] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:17.920434 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:17.920969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:17.927412 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:17.928082 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:17.928847 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:17.929315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:17.992828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:18.001024 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-15f3591f-4f24-437c-bdd8-f0f7cf5623cf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084451 Jul 19 15:54:18.001616 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 744/1471] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:18.668624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:18.669247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:18.675721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:18.676161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:18.676913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:18.677393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:18.805542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:18.813678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9a66823a-1b7d-49fe-b73d-e225d485c076 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148937 Jul 19 15:54:18.814241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 728/1472] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:18 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:19.018623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:19.019222 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:19.026151 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:19.026596 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:19.027354 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:19.027785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:19.090282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:19.098130 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-69fc232b-948f-4775-8fb8-ea2db38c098e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083638 Jul 19 15:54:19.098711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 745/1473] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:19.830630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:19.831251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:19.838515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:19.838959 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:19.839711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:19.840139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:19.968645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:19.977742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8d962a5b-e479-4c68-a8ef-697587b18ed8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151007 Jul 19 15:54:19.978300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 729/1474] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:19 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:20.115693 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:20.116296 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:20.122924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:20.123366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:20.124123 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:20.124551 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:20.184069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:20.191840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d3ad545a-7063-4110-a385-33ea34021207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080018 Jul 19 15:54:20.192396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 746/1475] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:20.995499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:20.996115 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:21.002519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:21.002956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:21.003710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:21.004137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:21.132859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:21.141378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d460926d-cdcf-4fcd-83e8-b8a2550689eb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149679 Jul 19 15:54:21.141940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 730/1476] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:21.210293 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:21.210895 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:21.217301 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:21.217751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:21.218509 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:21.218943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:21.283687 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:21.292568 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-23176067-dd83-4a67-add1-3136074fe291 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086796 Jul 19 15:54:21.293125 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 747/1477] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:22.158657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:22.159209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:22.165793 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:22.166245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:22.167006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:22.167435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:22.298009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:22.306919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fd97ce4e-4b82-49e0-b30f-dfce60b4140f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152189 Jul 19 15:54:22.307492 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 731/1478] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:22 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:22.309444 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:22.310089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:22.316419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:22.316865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:22.317719 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:22.318256 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:22.377840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:22.385695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f5955cfd-c561-492b-82f2-81354be02ce8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080181 Jul 19 15:54:22.386252 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 748/1479] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:23.324796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:23.325426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:23.331839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:23.332277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:23.333036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:23.334587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:23.403138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:23.403863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:23.410289 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:23.410804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:23.411805 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:23.412305 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:23.482891 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:23.491110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:23.491382 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f3aecd0e-50a9-436f-bc1b-eeab302e1991 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.092288 Jul 19 15:54:23.491946 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 749/1480] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:23.499228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-87e6daee-33c4-4468-bb8e-2c42ded67428 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.178304 Jul 19 15:54:23.499789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 732/1481] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:24.508666 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:24.509242 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:24.515871 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:24.516252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:24.516691 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:24.516848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:24.517068 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:24.517525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:24.520080 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:24.523980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:24.524425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:24.525192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:24.525617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:24.528180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:24.601785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:24.610012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a80a9e22-5223-4d0c-b2d1-b5db03308f18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.105755 Jul 19 15:54:24.610580 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 750/1482] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:24.674327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:24.682627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e60605cf-64d7-4a2a-a5de-c04744945523 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.170563 Jul 19 15:54:24.683198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 733/1483] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:25.630241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:25.631029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:25.638426 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:25.638903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:25.639732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:25.640160 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:25.699866 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:25.700481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:25.700987 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:25.707243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:25.707689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:25.708997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:25.709411 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6c07c8c5-5a68-42b9-b043-9f173d275c1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082704 Jul 19 15:54:25.709553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:25.709984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 751/1484] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:25.835786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:25.843660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aa4a14eb-6aee-4754-8576-94402925b7f0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147809 Jul 19 15:54:25.844225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 734/1485] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:25 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:26.726773 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:26.727396 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:26.734027 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:26.734473 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:26.735231 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:26.735665 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:26.797959 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:26.806617 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d46b6e89-5fc9-4170-87fe-fef1605e5852 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083945 Jul 19 15:54:26.807179 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 752/1486] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:26.861502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:26.862029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:26.869043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:26.869538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:26.870290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:26.870715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:27.001664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:27.009967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a19d7776-95c9-4e10-a594-37494bc4c88e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152329 Jul 19 15:54:27.010540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 735/1487] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:27.824423 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:27.825035 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:27.831133 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:27.831584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:27.832351 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:27.832787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:27.892692 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:27.901441 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-bc97ed84-11bc-4e9c-8e41-da3cb31fb862 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081080 Jul 19 15:54:27.902003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 753/1488] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:28.027100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:28.027711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:28.034213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:28.034660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:28.035422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:28.035862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:28.165706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:28.173510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-749f3623-00ea-4bcf-8c2d-838bfb11d700 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150213 Jul 19 15:54:28.174075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 736/1489] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:28.918731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:28.919269 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:28.925711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:28.926150 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:28.926903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:28.927445 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:28.987660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:28.995562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-37e9e5e3-e249-4b1e-b32c-cc54dafa4f04 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080744 Jul 19 15:54:28.996115 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 754/1490] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:29.191760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:29.192295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:29.194195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:29.199413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:29.199857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:29.200621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:29.201057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:29.330919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:29.338801 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9964c801-d3bc-49b8-9b65-a35410f4a31b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151196 Jul 19 15:54:29.339371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 737/1491] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:29 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:30.012458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:30.013059 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:30.019718 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:30.020156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:30.021645 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:30.022211 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:30.082352 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:30.091215 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2304faef-3097-4795-b294-a240cd6836bd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082617 Jul 19 15:54:30.092010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 755/1492] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:30.355790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:30.356344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:30.362749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:30.363193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:30.363953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:30.364932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:30.492681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:30.500544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8d5b0685-6aef-4e6a-ae87-e4c300c2b59a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148668 Jul 19 15:54:30.501099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 738/1493] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:30 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:31.107862 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:31.108483 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:31.110817 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=56 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:31.117070 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:31.117545 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:31.118325 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:31.118757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:31.181542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:31.190392 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7389b507-0778-48df-9b09-3857e44f78d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086339 Jul 19 15:54:31.190964 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 756/1494] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:31.518619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:31.519217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:31.525710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:31.526148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:31.526905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:31.527328 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:31.656001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:31.664354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dc29a1da-04fb-4dab-aca9-6fa1d79ae75b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149891 Jul 19 15:54:31.664916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 739/1495] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:32.206907 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:32.207507 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:32.215508 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:32.215981 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:32.216749 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:32.217243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:32.279911 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:32.288312 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ed143768-bc83-4fc2-a4fc-df1a9f6175d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085246 Jul 19 15:54:32.288880 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 757/1496] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:32.681645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:32.682243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:32.688650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:32.689091 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:32.689875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:32.690298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:32.824202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:32.832117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f6f9b58-b56f-40b8-a045-233a530efb0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154856 Jul 19 15:54:32.832696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 740/1497] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:32 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:33.304604 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:33.305229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:33.311647 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:33.312087 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:33.312840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:33.313302 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:33.372064 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:33.379871 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-e84a0bb9-3343-473d-83c3-6209a37c495f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079377 Jul 19 15:54:33.380419 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 758/1498] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:33.850039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:33.850626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:33.857044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:33.857511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:33.858268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:33.858695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:33.988124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:33.996973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cfe60832-f688-4ace-a144-3e15adfab507 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150862 Jul 19 15:54:33.997632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 741/1499] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:33 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:34.397162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:34.397797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:34.404209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:34.404661 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:34.405460 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:34.405899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:34.466777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:34.475236 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2bb50cc3-512e-42d6-9ec8-00f28c8ca5f3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081403 Jul 19 15:54:34.475790 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 759/1500] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:35.014639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:35.015543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:35.022116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.022566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.023833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.024271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.153976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:35.161816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f49ee88c-f69f-4cc7-8cc4-a52168da2b1d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151088 Jul 19 15:54:35.162383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 742/1501] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:35.492952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:35.493609 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:35.500267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.500709 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.501567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.501997 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.562401 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:35.570295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dfb516fa-b6f1-4d42-b1f5-903924405e63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081920 Jul 19 15:54:35.570850 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 760/1502] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:36.179650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:36.180244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:36.186862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.187306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.188065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.188498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.314951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:36.323365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aff36603-85bd-4d2d-9ea0-bad7875227a9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147673 Jul 19 15:54:36.323928 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 743/1503] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:36 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:36.587677 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:36.588264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:36.594740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.595181 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.595945 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.596376 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.656549 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:36.665041 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f93f1817-472a-475b-b1aa-ebdce375e92d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081602 Jul 19 15:54:36.665625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 761/1504] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:37.340722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:37.341361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:37.348106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.348547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:37.349340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.349770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:37.481947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:37.489945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1c58f89e-924c-47c4-8bf3-15e82b795e4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153074 Jul 19 15:54:37.490513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 744/1505] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:37.682006 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:37.682534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:37.689159 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.689623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:37.690425 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.690865 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:37.751674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:37.760116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9083abc8-1bc5-4dda-80de-da938dbf5425 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082046 Jul 19 15:54:37.760681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 762/1506] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:38.507230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:38.507937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:38.514229 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:38.514672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:38.515679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:38.516110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:38.644041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:38.652479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-587e9957-d707-48e6-93fa-a7e9ccbe76cc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149197 Jul 19 15:54:38.653122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 745/1507] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:38.777952 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:38.778494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:38.784884 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:38.785360 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:38.786142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:38.786569 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:38.845820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:38.854117 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9e7bfb40-08bb-46e1-86c2-040f293d9a1e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080061 Jul 19 15:54:38.854669 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 763/1508] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:39.669750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:39.670317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:39.676950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.677440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.678203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.678629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.810320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:39.818204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e56777a7-6c06-46b0-8318-80908a9217e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152443 Jul 19 15:54:39.818767 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 746/1509] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:39 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:39.872259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:39.872879 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:39.879295 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.879744 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.880530 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.880968 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.941203 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:39.949397 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-1d432b40-63b3-4912-9226-61826e874117 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080923 Jul 19 15:54:39.949948 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 764/1510] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:40.835804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:40.837046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:40.843528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.843975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.844730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.845182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.967456 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:40.968060 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:40.974821 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.975039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:40.975267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.976034 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.976463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.983104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-342aab10-422a-4bc4-8ac8-8e448f39e50e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151204 Jul 19 15:54:40.983672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 747/1511] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:40 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:41.038519 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:41.046469 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-c84f1f4c-8c31-4b0e-9832-7064b1804df3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082940 Jul 19 15:54:41.047032 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 765/1512] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:42.001781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:42.002384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:42.008841 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.009330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.010099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.010535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.063832 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:42.064467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:42.071542 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.072004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.072809 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.073287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.144733 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:42.146935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:42.154711 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8d141fa7-df8d-4055-b2ca-b4c25d23912f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.094714 Jul 19 15:54:42.155277 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 766/1513] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:42.166730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:42.174553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e1664573-7ad0-41e8-bdd5-edaad889526a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.176811 Jul 19 15:54:42.175100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 748/1514] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:43.171209 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:43.171820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:43.178467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.178924 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:43.179690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.180127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:43.191505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:43.192104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:43.199197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.199639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:43.200392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.200817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:43.244632 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:43.252983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-eec70689-d042-4f36-a63e-9099db31b585 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085568 Jul 19 15:54:43.253913 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 767/1515] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:43.337484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:43.339636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:43.346641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-648fc2a3-48b5-46ed-a460-95070c838c4a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.158965 Jul 19 15:54:43.347194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 749/1516] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:43 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:44.270900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:44.271514 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:44.278887 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:44.279402 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:44.280174 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:44.280624 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:44.344713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:44.353528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4ac51bfd-9692-4abd-8d50-50015ba3389b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086493 Jul 19 15:54:44.354101 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 768/1517] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:44.363244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:44.363849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:44.370595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:44.371040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:44.371805 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:44.372238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:44.501884 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:44.510630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8287a3a4-9522-4ab7-ac2c-05dcf10ad855 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151114 Jul 19 15:54:44.511137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 750/1518] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:45.370458 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:45.371071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:45.377638 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.378089 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.378855 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.379290 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.440241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:45.449399 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a6ed87cc-b475-4ed8-806a-3bc9e4252666 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082813 Jul 19 15:54:45.449960 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 769/1519] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:45.528340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:45.528870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:45.535367 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.535813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.536997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.537724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.668459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:45.676275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ea693666-8e49-4c18-aeec-a271bb1074e2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151992 Jul 19 15:54:45.676833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 751/1520] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:46.467029 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:46.467650 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:46.474055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.474494 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.475246 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.475674 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.535308 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:46.543785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3c2021ed-9290-49a3-951a-1c11e9c9fbb5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080770 Jul 19 15:54:46.544334 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 770/1521] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:46.693794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:46.694392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:46.701757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.702198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.702953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.703381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.830935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:46.839402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8e0cd88f-27c2-4ebe-94f8-ffe0ccbe9f81 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149410 Jul 19 15:54:46.839957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 752/1522] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:47.561283 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:47.561900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:47.568468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.568915 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.569705 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.570142 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.633731 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:47.642062 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2919d043-ea20-4804-bb60-824c0493f1d8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084686 Jul 19 15:54:47.642628 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 771/1523] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:47.857717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:47.858247 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:47.864603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.865038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.865814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.866241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.997951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:48.005907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c73a3dda-73bf-4859-b256-3476688f52f8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152781 Jul 19 15:54:48.006474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 753/1524] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:48.658655 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:48.659266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:48.665878 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:48.666372 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:48.667152 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:48.667588 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:48.729410 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:48.737438 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5378faf5-5bea-48bc-b9af-dc3895d96035 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082624 Jul 19 15:54:48.738001 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 772/1525] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:49.023746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:49.024379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:49.031211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.031657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.032419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.032849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.168642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:49.176493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-622085c1-5746-4025-9246-c597ac59c071 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156646 Jul 19 15:54:49.177060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 754/1526] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:49.753651 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:49.754243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:49.760748 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.761220 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.761984 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.762416 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.821582 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:49.829414 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6bf18413-ba74-4585-8082-b026c631b5c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079556 Jul 19 15:54:49.829962 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 773/1527] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:50.194163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:50.194751 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:50.201911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.202353 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:50.203105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.203532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:50.330915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:50.339139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-29b7547c-f899-4a78-a745-4c93b1fb0e86 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148846 Jul 19 15:54:50.339688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 755/1528] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:50 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:50.846275 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:50.846883 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:50.853357 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.855004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:50.855777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.856214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:50.919455 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:50.927285 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-9f31ca5a-cfae-49fa-8021-4da442310768 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084911 Jul 19 15:54:50.927848 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 774/1529] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:51.356163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:51.356770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:51.363373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:51.363818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:51.364583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:51.365016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:51.492394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:51.500935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ef0e5cef-9fd1-4414-a643-715976555333 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149289 Jul 19 15:54:51.501538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 756/1530] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:51 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:51.944282 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:51.944872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:51.951327 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:51.951775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:51.952543 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:51.952974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:52.012751 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:52.020972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ff80462b-648c-4b8f-a3cc-23b212810e38 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080546 Jul 19 15:54:52.021562 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 775/1531] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:52.519233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:52.519792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:52.526415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:52.526857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:52.527614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:52.528046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:52.660044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:52.668397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-32c70bff-a77a-4d90-a9d4-691d3bc296df tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153408 Jul 19 15:54:52.668958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 757/1532] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:52 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:53.037071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.037716 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:53.044585 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.045036 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.045826 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.046264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.107487 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.115313 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0bbded72-234a-49db-88fc-0d0001027dec tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082109 Jul 19 15:54:53.115863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 776/1533] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:53.686006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.686613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:53.693096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.693576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.694341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.694774 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.824545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.832610 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-59a12203-aeb7-4c21-8378-2771dfebdee7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151331 Jul 19 15:54:53.833186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 758/1534] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:54.132814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:54.133447 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:54.140555 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:54.141005 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:54.141794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:54.142225 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:54.204756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:54.212736 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-3e43f4c0-979c-4afe-a46e-0a111482a335 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084129 Jul 19 15:54:54.213316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 777/1535] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:54.850346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:54.850949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:54.857950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:54.858395 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:54.859157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:54.859589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:54.984233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:54.992100 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-909f4b1c-8f1b-4bf5-8d24-0b8241a26008 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.145629 Jul 19 15:54:54.992665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 759/1536] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:55.229974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:55.230589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:55.237046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:55.237523 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:55.238292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:55.238756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:55.298935 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:55.306778 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-7ff78760-edca-4390-a427-bd30e9cc3a48 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081497 Jul 19 15:54:55.307431 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 778/1537] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:56.010943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:56.011533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:56.018555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:56.019001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:56.019762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:56.020192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:56.150889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:56.158902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9317737b-55f0-4da5-947b-6e47b938231e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152927 Jul 19 15:54:56.159464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 760/1538] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:56.323567 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:56.324097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:56.330534 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:56.330972 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:56.331725 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:56.332156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:56.392072 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:56.399874 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2475cbf3-21de-4958-bca7-65e295e84866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080911 Jul 19 15:54:56.400547 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 779/1539] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:57.176546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:57.177189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:57.184518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:57.184969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:57.185755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:57.186187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:57.315152 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:57.323087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-21943746-57fb-4933-9f3e-2a95d49f742c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150835 Jul 19 15:54:57.323651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 761/1540] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:57 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:57.417251 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:57.417866 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:57.424413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:57.424864 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:57.425665 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:57.426106 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:57.490224 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:57.499241 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8a9d5ca5-e1a1-4932-85c4-63adb1cdabc4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086467 Jul 19 15:54:57.499792 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 780/1541] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:58.340680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:58.341327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:58.347789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:58.348779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:58.349584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:58.350021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:58.475128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:58.483687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ac69d7b-2a93-46ef-924a-7bcce92b5444 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147514 Jul 19 15:54:58.484250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 762/1542] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:58 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:58.516819 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:58.517387 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:58.523794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:58.524237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:58.524998 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:58.525895 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:58.585294 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:58.593321 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5d8e53fe-d311-4277-a85c-31d7c34503db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080600 Jul 19 15:54:58.593875 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 781/1543] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:59.501156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:59.501791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:59.503730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:59.508956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:59.509518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:59.510211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:59.510641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:59.609980 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:59.610592 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:59.617166 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:59.617625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:59.618394 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:59.619468 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:59.643391 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:59.651539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-512fc6b1-0823-4f24-bc8d-4efa2577d647 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154421 Jul 19 15:54:59.652108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 763/1544] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:59 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:59.679192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:59.687785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-332388bf-fd67-4838-aff8-d0b4c6e3e9df tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081647 Jul 19 15:54:59.688340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 782/1545] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:00.668901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:00.669533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:00.676018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:00.676466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:00.677270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:00.677703 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:00.704678 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:00.705309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:00.711791 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:00.712229 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:00.713168 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:00.713612 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:00.729949 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:00.789243 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:00.797900 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d384cd18-8bbe-4037-8a44-a15b5a506822 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.097108 Jul 19 15:55:00.798474 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 783/1546] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:00.826161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:00.833930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2e42389b-cff0-4f4e-9af2-462b04d329f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.169414 Jul 19 15:55:00.834479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 764/1547] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:00 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:01.815668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:01.816267 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:01.818594 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=56 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:01.824622 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:01.825071 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:01.825863 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:01.826299 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:01.851174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:01.851772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:01.858497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:01.858942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:01.859703 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:01.860126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:01.890978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:01.898918 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-dc09adeb-f318-4c69-a446-122329990431 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087107 Jul 19 15:55:01.899478 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 784/1548] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:01.990151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:01.998657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-204cd38f-0e52-4a31-9b25-7f72ceaa2a26 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151350 Jul 19 15:55:01.999220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 765/1549] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:02.915418 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:02.915994 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:02.922529 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:02.922978 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:02.923770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:02.924207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:02.983816 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:02.991631 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-79508381-0558-48ec-b437-bf96045bc77a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080141 Jul 19 15:55:02.992184 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 785/1550] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:03.015448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:03.016045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:03.022453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:03.022892 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:03.023642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:03.024069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:03.038904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:03.154577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:03.162523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cee4ae9f-7ed4-4478-9e6e-1b8887cb8c6c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151207 Jul 19 15:55:03.163081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 766/1551] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:04.008785 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:04.010170 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:04.016858 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:04.017358 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:04.018132 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:04.018572 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:04.078986 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:04.086903 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-2861524d-74d6-4ccc-9ff5-64274b2be39c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082061 Jul 19 15:55:04.087563 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 786/1552] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:04.179350 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:04.179958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:04.187000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:04.187447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:04.188209 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:04.188643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:04.316144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:04.324490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-53920bd1-7c2e-4a52-9e66-22e4d105497e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148936 Jul 19 15:55:04.325054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 767/1553] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:04 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:05.103840 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:05.104443 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:05.110917 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.111340 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.112094 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.112521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.178185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:05.186238 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ad0fe664-a10d-4005-a43e-171332f0c9a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086323 Jul 19 15:55:05.186787 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 787/1554] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:05.342223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:05.342944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:05.349443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.349893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.350658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.351095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.485280 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:05.494069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5d35f46e-549a-490a-b7fb-c8e5f25920bc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155119 Jul 19 15:55:05.494798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 768/1555] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:05 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:06.203195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:06.203806 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:06.210212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.210654 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.211420 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.211838 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.274346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:06.284103 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-777092c7-ed78-4ee8-a6c4-7d8d26bfb26e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084683 Jul 19 15:55:06.284757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 788/1556] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:06.514926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:06.515554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:06.523525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.523873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.524724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.525721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.669337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:06.677411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-28926122-19a8-4e14-b554-f3d977199d96 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.166653 Jul 19 15:55:06.677978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 769/1557] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:06 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:07.301128 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:07.301763 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:07.308905 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:07.309395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:07.310149 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:07.310578 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:07.373329 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:07.381201 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-42c7c3ff-c4ee-480d-9b86-a9edafe42da0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083870 Jul 19 15:55:07.381767 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 789/1558] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:07.694768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:07.695315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:07.702107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:07.702556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:07.703322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:07.703760 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:07.831735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:07.840289 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cac58599-226f-43d2-9a35-d589aa595c7c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149498 Jul 19 15:55:07.840852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 770/1559] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:07 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:08.397732 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:08.398346 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:08.404828 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:08.405315 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:08.406085 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:08.406521 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:08.470073 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:08.477979 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-123e2807-571b-4ccb-8be9-11e2b1a9101f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084125 Jul 19 15:55:08.478535 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 790/1560] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:08.858241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:08.858848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:08.865345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:08.865792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:08.866551 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:08.866984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:08.999986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:09.007846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-be9e4000-4b83-4f73-a6fb-429ad3573b7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153988 Jul 19 15:55:09.008413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 771/1561] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:09.494756 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:09.495361 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:09.501801 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:09.502247 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:09.503004 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:09.503484 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:09.562688 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:09.570699 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-d86c01fd-9c39-4d1d-8dcb-3844e340852c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079857 Jul 19 15:55:09.571264 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 791/1562] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:10.025218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:10.025799 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:10.032181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:10.032626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:10.033404 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:10.033856 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:10.164131 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:10.172652 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a7e8ba43-142c-4f5d-9418-7e2f43839a41 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151423 Jul 19 15:55:10.173253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 772/1563] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:10.588520 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:10.589234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:10.595937 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:10.596375 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:10.597149 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:10.597584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:10.657623 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:10.666148 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8fabb555-10c7-416a-b2f1-7ee6810a801e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081142 Jul 19 15:55:10.666470 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 792/1564] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:11.190304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:11.190895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:11.197509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:11.197954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:11.198732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:11.199159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:11.328441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:11.336665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-54eb6bdd-648a-41fb-868b-37edcfd42146 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150035 Jul 19 15:55:11.337837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 773/1565] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:11 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:11.682833 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:11.683554 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:11.690010 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:11.690467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:11.691230 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:11.691664 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:11.753881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:11.762254 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ec640deb-08a8-4e1d-b2c5-7adbe3f9113f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083286 Jul 19 15:55:11.762814 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 793/1566] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:12.354900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:12.355504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:12.361969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:12.362421 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:12.363181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:12.363619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:12.722844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:12.730902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-71b8a64a-3cd8-47bb-9de6-043bb0a3cf1b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.380313 Jul 19 15:55:12.731489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 774/1567] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:12 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:12.779963 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:12.780602 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:12.787033 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:12.787477 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:12.788234 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:12.788668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:12.849192 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:12.857046 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-787ccc1e-5f64-4eec-a56b-1332627e0811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081457 Jul 19 15:55:12.857625 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 794/1568] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:13.748212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:13.748815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:13.755415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:13.755863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:13.756935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:13.757480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:13.874095 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:13.874696 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:13.881322 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:13.881845 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:13.882689 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:13.883156 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:13.889307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:13.897417 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ad76bc69-c8fe-4e8d-9fe3-8211334cd9f6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153053 Jul 19 15:55:13.898059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 775/1569] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:13 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:13.944138 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:13.952782 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-887ba452-d1dc-4c2d-942b-6bc23126ca66 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082476 Jul 19 15:55:13.953374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 795/1570] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:14.917528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:14.918096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:14.925447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:14.925893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:14.926663 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:14.927089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:14.970467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:14.971260 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:14.978608 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:14.978971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:14.979745 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:14.980176 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:15.066695 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:15.075240 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f7bd440d-aeed-4f38-ba8a-a5b9b64be25e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.108667 Jul 19 15:55:15.075813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 796/1571] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:15.098890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:15.106902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d77df73d-8747-4383-ba7b-019a3976459f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.194650 Jul 19 15:55:15.107463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 776/1572] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:14 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:16.091827 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:16.092467 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:16.098886 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:16.099331 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:16.100087 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:16.100517 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:16.124413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:16.125013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:16.131465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:16.131905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:16.132666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:16.133098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:16.161407 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:16.170237 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-83fd87c8-292e-403a-8c91-f4ca9737b1c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082252 Jul 19 15:55:16.170813 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 797/1573] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:16.263998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:16.272218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eb09f515-1698-4239-97e8-5617236c4d44 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151595 Jul 19 15:55:16.272785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 777/1574] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:17.187646 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:17.188258 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:17.194757 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:17.195206 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:17.195975 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:17.197012 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:17.258097 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:17.267195 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-6b282e58-36ca-4905-8805-b09f7dc6244e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083217 Jul 19 15:55:17.268003 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 798/1575] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:17.288983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:17.289620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:17.296043 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:17.296487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:17.297286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:17.297721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:17.426484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:17.435060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8fe9ddd2-f4c3-4eae-aabf-8add809708f4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150015 Jul 19 15:55:17.435622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 778/1576] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:18.285759 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:18.286364 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:18.293430 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:18.293872 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:18.294629 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:18.295055 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:18.356668 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:18.364459 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f8674cb4-5511-4b68-a56b-6a350f7d28ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083848 Jul 19 15:55:18.365013 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 799/1577] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:18.452452 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:18.453089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:18.459650 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:18.460096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:18.460855 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:18.461318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:18.591982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:18.599850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8e528c55-db8b-452b-b0f4-a6be588b0e10 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151332 Jul 19 15:55:18.600399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 779/1578] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:18 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:19.381374 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:19.381976 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:19.389158 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:19.389881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:19.390639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:19.391069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:19.393589 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_cell1:SELECT=100 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:19.451367 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:19.459197 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-4cbf50d3-8477-4399-9fab-874962fb5e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081710 Jul 19 15:55:19.459762 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 800/1579] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:19.616738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:19.617294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:19.624430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:19.624868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:19.625646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:19.626075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:19.766134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:19.774341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ca8d7fe1-81fd-4474-a6a2-dda0f4a4e03f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.161213 Jul 19 15:55:19.774341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 780/1580] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:19 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:20.476983 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:20.478492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:20.484941 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:20.485413 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:20.486177 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:20.486607 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:20.547403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:20.555266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-ebe91f64-a2fb-4eba-9566-10fe01d90811 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082124 Jul 19 15:55:20.556366 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 801/1581] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:20.791821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:20.792491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:20.799052 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:20.799449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:20.800214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:20.800654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:20.932519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:20.940444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-36fbe09e-71d2-4095-82a4-1f7d68503be5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153112 Jul 19 15:55:20.941005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 781/1582] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:21.573427 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:21.574069 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:21.580639 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:21.581092 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:21.581899 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:21.582337 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:21.642111 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:21.650754 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-21f17181-3f11-470e-8a57-6e7d95b1e965 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081711 Jul 19 15:55:21.651316 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 802/1583] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:21.957881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:21.958444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:21.965117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:21.965585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:21.966351 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:21.966784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:22.095540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:22.103378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5de24a07-396b-47be-9d85-ce8fbb7aaeb6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149446 Jul 19 15:55:22.103933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 782/1584] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:21 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:22.668513 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:22.669118 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:22.675681 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:22.676127 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:22.676890 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:22.677356 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:22.739162 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:22.747908 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-8ec0c594-247f-4700-a8b3-e87d8603e151 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083649 Jul 19 15:55:22.748463 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 803/1585] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:23.121055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:23.121697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:23.128085 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:23.128526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:23.129308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:23.129739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:23.132217 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:23.260189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:23.268676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b56d87ec-ff1d-44d7-b811-10046b0be8c0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152114 Jul 19 15:55:23.269267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 783/1586] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:23.764943 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:23.765584 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:23.772032 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:23.772481 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:23.773259 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:23.773690 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:23.832958 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:23.840777 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0fc1952c-27e1-4f25-9954-97803651985f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080091 Jul 19 15:55:23.841369 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 804/1587] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:24.285888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:24.286498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:24.293652 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:24.294097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:24.294857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:24.295301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:24.424411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:24.432677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-afafb673-1049-4041-8604-8040bf3c142d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150568 Jul 19 15:55:24.433266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 784/1588] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:24.857153 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:24.857788 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:24.864130 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:24.864570 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:24.865353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:24.865783 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:24.925528 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:24.933944 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-5d8be043-8f61-4c98-8c14-f41ec4a20a3f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080644 Jul 19 15:55:24.934525 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 805/1589] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:25.449985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:25.450594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:25.457076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:25.457553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:25.458313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:25.458747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:25.593577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:25.601475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-081d6225-e2e8-4bc0-8976-87b2e4f7a89a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155412 Jul 19 15:55:25.602638 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 785/1590] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:25 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:25.951553 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:25.952116 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:25.958510 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:25.958974 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:25.959713 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:25.960141 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:26.019207 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:26.027852 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-763c2fd1-a902-4467-8107-aad4dfb5660f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080294 Jul 19 15:55:26.028406 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 806/1591] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:26.619517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:26.620069 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:26.626506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:26.626956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:26.627849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:26.628133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:26.754747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:26.763017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-61dc1b3f-775c-4a41-92ea-f8085d1eb124 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147982 Jul 19 15:55:26.763583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 786/1592] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:27.045185 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:27.045804 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:27.052287 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:27.052740 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:27.053605 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:27.054047 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:27.119889 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:27.127797 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-45a9760a-5dc7-44d7-ba5f-ee2366da794f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086438 Jul 19 15:55:27.128365 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 807/1593] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:27.780842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:27.781474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:27.787985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:27.788424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:27.789204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:27.789633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:27.918646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:27.926483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ff6968f-cb0b-4acd-aa16-8406c4a65540 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149693 Jul 19 15:55:27.927046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 787/1594] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:27 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:28.145769 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:28.146343 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:28.152812 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.153292 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:28.154057 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.154482 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:28.214504 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:28.222475 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-fa78516d-7c30-49fe-ae31-c8de249debf1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080732 Jul 19 15:55:28.223033 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 808/1595] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:28.943795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:28.944336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:28.951516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.951965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:28.952758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.953212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.081426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:29.090021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8738576e-6863-417c-8124-7a8e1ab2d8f7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150175 Jul 19 15:55:29.090587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 788/1596] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:29.240079 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:29.240794 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:29.247309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:29.247775 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.248544 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:29.248971 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.310266 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:29.318113 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-a71cd646-500a-4e7a-b020-55c2150573d5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081932 Jul 19 15:55:29.318660 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 809/1597] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:30.107571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:30.108168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:30.110440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:30.115945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.116392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.117163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.117594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.245030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:30.253161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dd0d32c8-6280-41dc-9b29-6cf212a23d5b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150114 Jul 19 15:55:30.253727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 789/1598] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:30 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:30.335488 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:30.336090 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:30.343110 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.343560 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.344309 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.344738 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.405635 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:30.413333 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-0fed1cf6-e5f2-4e11-bb3d-1c6508d9d00e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081599 Jul 19 15:55:30.413884 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 810/1599] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:31.271931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:31.272535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:31.279623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.280061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.280813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.281272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.413419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:31.421997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ce4a075e-05c6-4f49-a8f9-e0160bcdcc61 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155178 Jul 19 15:55:31.422555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 790/1600] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:31.430630 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:31.432353 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:31.438770 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.439212 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.439969 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.440403 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.501642 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:31.510031 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-f433febe-eef1-4acc-aabd-95931322048a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082582 Jul 19 15:55:31.510536 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 811/1601] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:32.439458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:32.440057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:32.446494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.446932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.447689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.448118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.528077 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:32.528881 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.compute.api [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118006) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:32.531395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG dbcounter [-] [118006] Writing DB stats nova_api:SELECT=56 {{(pid=118006) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:32.536820 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.537388 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.538214 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.538712 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG oslo_concurrency.lockutils [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118006) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.589665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:32.597816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-152114e6-582a-402f-97e8-5f0dffe65e75 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.162177 Jul 19 15:55:32.598472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 791/1602] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:32 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:32.606147 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.policy [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118006) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:32.613950 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: INFO nova.api.openstack.requestlog [None req-14e93347-e931-476d-91fb-e68466e96931 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.090780 Jul 19 15:55:32.614492 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: [pid: 118006|app: 0|req: 812/1603] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:32.888297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:55:32.888484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:55:33.615112 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:33.615750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:33.622718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.623137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.623892 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.624318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.630641 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: DEBUG nova.api.openstack.wsgi [None req-31103d23-9d9b-4e90-9692-0f7b88f3ba9b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118006) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:33.647213 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: Traceback (most recent call last): Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: timer() Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: cb(*args, **kw) Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: waiter.switch() Jul 19 15:55:33.647395 dv-cinder-849846-2-iscsi devstack@n-api.service[118006]: greenlet.error: cannot switch to a different thread Jul 19 15:55:33.752967 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:33.761061 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-453bbe6e-695a-45a8-8bbc-f60f8c8daac5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149957 Jul 19 15:55:33.761684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 792/1604] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:33 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:34.779380 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:34.780016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:34.786460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:34.786904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:34.787660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:34.788090 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:34.919261 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:34.927161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9747e1bf-84b4-47ad-a447-4a9b51948528 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152218 Jul 19 15:55:34.927723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 793/1605] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:35.943701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:35.944411 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:35.951058 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:35.951497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:35.952245 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:35.952666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.078383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:36.086218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8a4322cf-58fa-4097-b3ef-3f1d0aec7fe5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146357 Jul 19 15:55:36.086768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 794/1606] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:37.104019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:37.104684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:37.111138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.111584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.112344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.112776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.244670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:37.257539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d26fd9b7-2095-4181-adc3-d308863c3e2a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.157222 Jul 19 15:55:37.258385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 795/1607] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:38.276308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:38.276917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:38.283415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:38.283858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:38.284616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:38.285044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:38.420427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:38.428368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-078a7d01-442e-4da8-a524-edc3c8d82717 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.156763 Jul 19 15:55:38.428921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 796/1608] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:39.446004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:39.447293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:39.454106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:39.454558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:39.455325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:39.455764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:39.583230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:39.592572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ddd229b7-1d30-4fc9-bef5-06ba70febb8e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150422 Jul 19 15:55:39.593127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 797/1609] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:39 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:40.609727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:40.610370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:40.616717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.617187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.617951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.619244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.750846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:40.758688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-914bd5c4-2159-41c1-bed0-66aa576a064b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152966 Jul 19 15:55:40.759822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 798/1610] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:40 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:41.776485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:41.777171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:41.783623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:41.784068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:41.784934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:41.785392 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:41.914072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:41.916716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:41.923442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d9a59308-8339-4dad-96b7-de59887c8629 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151498 Jul 19 15:55:41.924004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 799/1611] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:42.939922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:42.940911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:42.948701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:42.949169 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:42.949954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:42.950389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.079764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:43.088199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a8addc07-c7ae-4cf9-adbd-e0684bd061f9 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152327 Jul 19 15:55:43.088757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 800/1612] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:44.106309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:44.106956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:44.113456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.113905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.114667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.115097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.244661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:44.252636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-62b1fbd0-5c4d-44bc-90d6-de3720d8dce1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150693 Jul 19 15:55:44.253213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 801/1613] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:45.270271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:45.270984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:45.277592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:45.278033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:45.278784 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:45.279213 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:45.407447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:45.415831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-87da5aea-af4b-48a9-bd48-f2fd0dcb6833 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148805 Jul 19 15:55:45.416384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 802/1614] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:46.433203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:46.433845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:46.440178 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:46.440648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:46.441422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:46.441853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:46.573933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:46.581750 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b57ab725-563a-4a41-8156-8f63d3512c8d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153018 Jul 19 15:55:46.582306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 803/1615] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:46 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:47.599448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:47.600067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:47.606673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:47.607124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:47.607900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:47.608335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:47.736112 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:47.744582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-870123d6-5f5d-407b-9d3a-1b35f644214a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149095 Jul 19 15:55:47.745161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 804/1616] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:48.761431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:48.762040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:48.768660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:48.769098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:48.769882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:48.770312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:48.903902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:48.911858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-279ca774-04b9-4b62-9d2b-10d24992628d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155026 Jul 19 15:55:48.912418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 805/1617] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:48 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:49.928937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:49.929684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:49.936271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:49.936649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:49.937425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:49.937852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:50.063533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:50.071897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4ecd8734-df1f-4691-87c6-939389862fb2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146828 Jul 19 15:55:50.072902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 806/1618] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:51.089423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:51.090076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:51.096481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:51.096931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:51.097728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:51.098167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:51.229830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:51.237925 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-008cac45-c58a-42ad-bb63-32910592f41b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153000 Jul 19 15:55:51.238482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 807/1619] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:51 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:52.254881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:52.255532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:52.262103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:52.262554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:52.263325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:52.263768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:52.393710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:52.401934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9d3dc419-c933-4356-8aeb-716447add600 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151053 Jul 19 15:55:52.402499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 808/1620] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:52 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:53.419409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:53.420080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:53.426474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:53.426919 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:53.427676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:53.428107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:53.559390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:53.567179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f31c03d7-1663-49ac-98fd-f9c09b2a5702 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152083 Jul 19 15:55:53.567738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 809/1621] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:53 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:54.583871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:54.584543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:54.591625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:54.592068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:54.592816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:54.593269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:54.721752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:54.729802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b74404e6-3641-42ec-bf27-4c98178e8ef5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149912 Jul 19 15:55:54.730365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 810/1622] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:55.746659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:55.747360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:55.753671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:55.754111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:55.754859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:55.755286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:55.881519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:55.889744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dde50a2a-6bfd-4297-812f-e64e77b0007b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146663 Jul 19 15:55:55.890309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 811/1623] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:55 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:56.165827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:55:56.166044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:55:56.907489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:56.908136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:56.915615 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:56.916085 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:56.916844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:56.917304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:57.044164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:57.052018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6aedbb77-3dab-4957-b269-03844e37d32e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148525 Jul 19 15:55:57.052567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 812/1624] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:58.069761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:58.070441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:58.077676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:58.078127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:58.078904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:58.079356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:58.208307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:58.216273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-43727be4-9a7e-47fe-a228-bc7e03c66f7f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150428 Jul 19 15:55:58.216840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 813/1625] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:58 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:59.233732 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:59.234420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:59.240560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:59.240999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:59.241791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:59.242214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:59.375337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:59.383823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e043596b-1e97-4a19-b28e-9d54704ad640 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153692 Jul 19 15:55:59.384387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 814/1626] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:59 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:00.402064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:00.402691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:00.405045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:00.410381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:00.410827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:00.411590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:00.412023 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:00.544301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:00.552224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-80a9014d-5f90-4dce-ac64-960aefc02688 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155060 Jul 19 15:56:00.552782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 815/1627] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:00 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:01.569963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:01.570603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:01.576786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:01.577260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:01.578028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:01.578470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:01.593603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:01.706857 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:01.715361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e2c44e12-dce6-480e-8593-985410b3a697 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149357 Jul 19 15:56:01.715922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 816/1628] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:02.732502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:02.733110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:02.739673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:02.740124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:02.740889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:02.741359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:02.871821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:02.879772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d579096f-ace3-4290-b16e-4cde2bca640e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151120 Jul 19 15:56:02.880330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 817/1629] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:02 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:03.899081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:03.899775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:03.906257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:03.906709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:03.907480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:03.907918 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:04.034463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:04.043028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4a157069-3c30-4200-8440-00c4b2cb7dde tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148690 Jul 19 15:56:04.043603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 818/1630] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:05.060472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:05.061241 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:05.067956 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:05.068406 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:05.069192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:05.069632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:05.196370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:05.204255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ddfaa1d2-8b67-474a-80d9-cf38a13775e0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147636 Jul 19 15:56:05.204803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 819/1631] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:05 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:06.221679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:06.222362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:06.228783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:06.229256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:06.230012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:06.230441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:06.360134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:06.368442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1ef74079-da59-4846-9d40-68b815342758 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150671 Jul 19 15:56:06.368990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 820/1632] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:06 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:07.386561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:07.387202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:07.397681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:07.398125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:07.399713 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:07.400146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:07.527431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:07.535204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b23c5101-6d81-440f-b4a2-92950f045df1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153538 Jul 19 15:56:07.535756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 821/1633] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:07 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:08.552273 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:08.552921 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:08.560192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:08.560639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:08.561427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:08.561861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:08.693444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:08.701863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-78d4ef18-0c44-4320-84ca-78c91288684e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153600 Jul 19 15:56:08.702423 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 822/1634] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:09.719904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:09.720554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:09.726800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:09.727239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:09.727988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:09.728416 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:09.855668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:09.863560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-11ba112c-8e34-48fe-ae52-c833f3c5d1ce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147574 Jul 19 15:56:09.864116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 823/1635] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:09 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:10.880414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:10.881033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:10.887576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:10.888019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:10.888765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:10.889474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:11.015373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:11.023889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4b55dde8-73e9-4be5-be03-d75f232cbd84 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146766 Jul 19 15:56:11.024442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 824/1636] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:12.041602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:12.042296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:12.048808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:12.049322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:12.050111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:12.050550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:12.188979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:12.197307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b7ea4a6f-d187-4188-8bd4-8ec96cf5e64a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.160215 Jul 19 15:56:12.197879 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 825/1637] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:12 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:13.214293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:13.215000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:13.221445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:13.221891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:13.222656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:13.223087 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:13.354194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:13.362071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8f21c6d1-c63a-44cf-9cb2-db8dead781a4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151713 Jul 19 15:56:13.362632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 826/1638] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:13 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:14.380260 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:14.380909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:14.388010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.388463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.389510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.389952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.534306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:14.542707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ec32b319-d59e-4045-b201-899eb4663ad3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.166338 Jul 19 15:56:14.543272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 827/1639] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:14 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:15.562773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:15.563453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:15.572074 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:15.572518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:15.573311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:15.573980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:15.727667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:15.739922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-501c00ae-95a1-4115-bf90-7866f4bd36b2 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.183459 Jul 19 15:56:15.740518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 828/1640] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:15 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:16.759936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:16.760575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:16.767464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:16.767912 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:16.768682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:16.769122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:16.900752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:16.908697 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3b7bd465-7515-41cb-91ea-850f20365d17 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152812 Jul 19 15:56:16.909225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 829/1641] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:17.926600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:17.927293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:17.934315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:17.934765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:17.935526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:17.935960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:18.070722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:18.078687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3025bf43-225b-4b11-8f85-c1cfdc408d46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155969 Jul 19 15:56:18.079427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 830/1642] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:19.097332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:19.098018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:19.104835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.105313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.106067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.106494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.241459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:19.250665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b4ed3820-6ce2-4bfa-94a5-476999877e9a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.157192 Jul 19 15:56:19.251239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 831/1643] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:19 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:20.268904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:20.269617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:20.278541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.279265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.280480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.281133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.416708 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:20.424505 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-916672a3-c037-4e8c-b4ae-177cbde8473d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159465 Jul 19 15:56:20.425077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 832/1644] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:21.442394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:21.443060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:21.450077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.450514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.451270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.451696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.454265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:21.578335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:21.587527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0a2e9b8c-fed5-4edb-8bc1-b16169384284 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148992 Jul 19 15:56:21.588104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 833/1645] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:21 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:22.605987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:22.606641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:22.612396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.612838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.613619 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.614048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.746258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:22.754150 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4eab6b0f-051d-475d-b21d-91cca2ef9fce tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153288 Jul 19 15:56:22.754706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 834/1646] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:22 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:23.770809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:23.771470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:23.778167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.778608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.779368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.779798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.907438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:23.916143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-724698a9-d6cf-4642-917e-bd042e89956d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149207 Jul 19 15:56:23.916712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 835/1647] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:24.933769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:24.934429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:24.940809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.941291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:24.942060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.942500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.073250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:25.081084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f25ed048-2046-4604-b382-ee614f71786b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151950 Jul 19 15:56:25.081685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 836/1648] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:26.098410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:26.099338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:26.106267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.106705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.107456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.107886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.237228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:26.246318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-09ff8007-23b5-4ae8-8e0d-0ace23468e0d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151422 Jul 19 15:56:26.246878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 837/1649] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:27.263250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:27.264125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:27.270616 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:27.271064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:27.271822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:27.272258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:27.400016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:27.407973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ae0d5789-8a13-4701-a712-018832a06da3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148599 Jul 19 15:56:27.408541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 838/1650] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:27 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:28.425545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:28.426198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:28.433424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:28.433861 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:28.434639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:28.435065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:28.564661 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:28.572715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-161f77bf-0c20-4deb-b30d-c8f27e10dd47 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150978 Jul 19 15:56:28.573301 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 839/1651] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:28 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:29.590481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:29.591128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:29.597218 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:29.597671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:29.598435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:29.598869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:29.726887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:29.734776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-746fa899-9aec-46d6-a48a-97d031bd5ea0 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148297 Jul 19 15:56:29.735339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 840/1652] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:29 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:30.752068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:30.752670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:30.754963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=52 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:30.760618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:30.761056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:30.761839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:30.762265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:30.893322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:30.901384 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8a6dad45-f15e-4fcf-9bc6-bb7cc9478fca tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153104 Jul 19 15:56:30.901947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 841/1653] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:30 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:31.919825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:31.920479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:31.926941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:31.927381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:31.928132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:31.928558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:32.058695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:32.066664 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-05a0d4db-f906-4dab-affe-a109f9060e0a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151676 Jul 19 15:56:32.067223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 842/1654] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:31 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:33.083859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:33.084483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:33.091541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:33.091989 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:33.092748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:33.093212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:33.221196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:33.229931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6f53eaee-f967-4941-b943-307744d300b7 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150007 Jul 19 15:56:33.230540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 843/1655] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:33 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:33.691430 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:33.692037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:33.698586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:33.699035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:33.699844 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:33.700333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:33.763188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:33.771341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d3327016-5cd9-4336-b01b-d720325df455 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083808 Jul 19 15:56:33.771902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 844/1656] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:34.247529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:34.248185 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:34.254854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:34.255295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:34.256118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:34.256545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:34.384985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:34.393322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-21deab1d-5db3-4992-a0c2-61d9a8d42385 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150323 Jul 19 15:56:34.393885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 845/1657] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:34 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:34.790096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:34.790715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:34.796724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:34.797205 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:34.797970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:34.798405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:34.857968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:34.865755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e4993754-e12c-4052-af0f-a26cc86d946b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080124 Jul 19 15:56:34.866317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 846/1658] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:35.410662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:35.411372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:35.418084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:35.418531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:35.419295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:35.419733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:35.555821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:35.563720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-df175dde-c27d-47aa-a736-cf881623ba1e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.157141 Jul 19 15:56:35.564285 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 847/1659] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:35 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:35.882922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:35.883598 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:35.889968 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:35.890422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:35.891186 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:35.891622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:35.950756 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:35.959773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ff5610b8-82f1-4711-9aaf-94d1ca8cfdc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080841 Jul 19 15:56:35.960337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 848/1660] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:36.580582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:36.581228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:36.588906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:36.589455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:36.590222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:36.590657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:36.719718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:36.721954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:36.728942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3f2e96d5-a059-45ab-a576-956e6da96a6d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152334 Jul 19 15:56:36.729535 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 849/1661] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:36 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:36.976341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:36.976960 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:36.982853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:36.983290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:36.984040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:36.984466 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:37.050665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:37.058984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-77e4de65-2a0f-44d9-a548-9f1fd3f00eb4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086473 Jul 19 15:56:37.059540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 850/1662] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:37.746271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:37.746973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:37.753363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:37.753814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:37.754575 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:37.755012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:37.884387 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:37.892690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-690b8c1c-1cd4-4c69-ab03-a1fd2d1e99c8 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150416 Jul 19 15:56:37.893305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 851/1663] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:37 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:38.076626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:38.077193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:38.083195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:38.083646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:38.084414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:38.084845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:38.145529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:38.153937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-447cada0-5e85-4be8-b9a0-9f976a4d7a74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081317 Jul 19 15:56:38.154496 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 852/1664] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:38.910341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:38.910943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:38.918054 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:38.918498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:38.919375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:38.919830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:39.049371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:39.057709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b7010c58-fc10-4df2-bf81-426972a5527f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151247 Jul 19 15:56:39.058267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 853/1665] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:38 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:39.171286 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:39.171888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:39.177796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:39.178242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:39.178999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:39.179432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:39.239508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:39.247766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5a822e87-72c0-4cda-a518-37d9bb8088b9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080053 Jul 19 15:56:39.248264 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 854/1666] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:40.075818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:40.076498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:40.082901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:40.083342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:40.084093 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:40.084523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:40.217382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:40.225282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b529225e-0c8d-46b6-9fde-b24033dc5fa6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153311 Jul 19 15:56:40.225839 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 855/1667] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:40 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:40.264276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:40.264874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:40.270936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:40.271377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:40.272133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:40.272559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:40.336740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:40.344606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0dc06766-ff9d-435e-9902-ad2ce9b511ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084645 Jul 19 15:56:40.345369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 856/1668] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:41.243819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:41.244501 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:41.251276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:41.251712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:41.252472 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:41.252897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:41.383788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:41.392070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eae7ade8-31b7-4e7d-9cc1-cd8984525443 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152690 Jul 19 15:56:41.392632 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 857/1669] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:41 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:41.397110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:41.397731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:41.403470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:41.403974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:41.404742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:41.405234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:41.464696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:41.472682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ee8773e9-b711-4e99-a16a-e1074a17f06a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079111 Jul 19 15:56:41.473266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 858/1670] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:42.409063 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:42.409764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:42.416334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:42.416778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:42.417564 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:42.417998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:42.549897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:42.557924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-99fb1693-c10a-4852-add8-ccb2df0abc68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152738 Jul 19 15:56:42.558489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 859/1671] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:42 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:42.564018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:42.564991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:42.574011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:42.574695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:42.575878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:42.576542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:42.638988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:42.646763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f89346ea-8af4-4730-97b7-c898a3fee0c5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087332 Jul 19 15:56:42.647320 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 860/1672] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:43.575270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:43.575926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:43.582342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:43.582794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:43.583556 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:43.583990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:43.718126 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:43.726077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-aab1550c-46fe-4cfc-bc19-4da1ef3f8a46 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154769 Jul 19 15:56:43.726662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 861/1673] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:43 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:43.732132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:43.732733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:43.738317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:43.738758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:43.739517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:43.739949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:43.806608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:43.815162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20b1d51e-2116-4954-a6c8-d8696c54b9c0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086130 Jul 19 15:56:43.816181 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 862/1674] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:44.744265 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:44.744858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:44.751312 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:44.751755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:44.752511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:44.752945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:44.889829 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:44.897785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1c77c670-3e74-49b5-bb6c-b30faef29b3a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.157983 Jul 19 15:56:44.898354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 863/1675] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:44 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:44.903764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:44.904359 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:44.910071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:44.910519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:44.911290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:44.911726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:44.972081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:44.980609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dd08b57b-9e34-4c11-8a78-4b81ade4b510 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080396 Jul 19 15:56:44.981199 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 864/1676] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:45.915684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:45.916309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:45.922765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:45.923212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:45.923970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:45.924403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:46.056698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:46.064651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ce2734c4-bd32-4ccb-b012-25b01d00734f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153598 Jul 19 15:56:46.065239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 865/1677] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:45 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:46.069565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:46.070162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:46.075741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:46.076211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:46.076977 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:46.077446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:46.092139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:46.139193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:46.146953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6d96f0e1-941e-447b-9c57-d3f6776b759f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080788 Jul 19 15:56:46.147512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 866/1678] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:47.081996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:47.082649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:47.089688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:47.090134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:47.090891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:47.091322 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:47.218434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:47.226237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-239c1066-9f56-4c03-a01d-420ca6abf347 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148166 Jul 19 15:56:47.226947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 867/1679] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:47 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:47.231243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:47.231831 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:47.237438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:47.237880 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:47.238639 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:47.239067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:47.303896 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:47.312454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3c934c88-0635-41c6-9ce7-2bccbc4e2bd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084563 Jul 19 15:56:47.313003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 868/1680] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:48.243450 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:48.244267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:48.250842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:48.251278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:48.252038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:48.252465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:48.382668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:48.391604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1e26f68c-df18-49aa-afe0-b47f1933543d tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152058 Jul 19 15:56:48.392172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 869/1681] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:48 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:48.396563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:48.397179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:48.403599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:48.404044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:48.404810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:48.405270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:48.466151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:48.474123 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c379d010-408b-4aa1-a1f4-a9db8204dfba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081013 Jul 19 15:56:48.474695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 870/1682] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:49.409920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:49.410582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:49.417847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:49.418284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:49.419035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:49.419460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:49.550269 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:49.558662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6d2fb2a6-476c-417f-a843-c0e59145e255 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152612 Jul 19 15:56:49.559225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 871/1683] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:49 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:49.563577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:49.564180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:49.569738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:49.570179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:49.570933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:49.571365 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:49.637961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:49.646049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c6ba8441-a3a4-4405-8a2d-1d9bcf64929f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085899 Jul 19 15:56:49.646613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 872/1684] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:50.575655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:50.576317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:50.583347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:50.583788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:50.584544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:50.584972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:50.712509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:50.720947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-873b97c0-0e10-46f1-b684-b34e658ac0ac tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149238 Jul 19 15:56:50.721540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 873/1685] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:50 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:50.725955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:50.726548 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:50.733068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:50.733540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:50.734299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:50.734730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:50.797894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:50.805782 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-16934c5e-7052-4d39-adb9-c51b5c5d5f7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083318 Jul 19 15:56:50.807418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 874/1686] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:51.738076 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:51.738902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:51.745189 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:51.745633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:51.746385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:51.746808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:51.874509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:51.882402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-879b4aff-65d4-4213-8374-3dc83d5950da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148199 Jul 19 15:56:51.882964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 875/1687] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:51 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:51.887843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:51.888695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:51.894426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:51.894867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:51.895621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:51.896051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:51.955673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:51.964345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-49d59168-8db8-43a5-a742-76c9a484a11a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080449 Jul 19 15:56:51.964911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 876/1688] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:52.899623 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:52.900895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:52.907563 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:52.908000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:52.908753 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:52.909271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:53.037253 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:53.045889 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bbc29fca-eb35-4590-abe7-7f914dc3df36 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150140 Jul 19 15:56:53.046457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 877/1689] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:52 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:53.055304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:53.055304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:53.057573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:53.058025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:53.058795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:53.059233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:53.117614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:53.125978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3222437e-9183-4dfd-89bb-b5f5173c5efc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.078578 Jul 19 15:56:53.126541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 878/1690] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:54.063208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:54.063901 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:54.070308 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:54.070748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:54.071497 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:54.072833 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:54.202330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:54.210298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7337ec0d-bdf4-4882-8295-b368ac21761c tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150944 Jul 19 15:56:54.210863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 879/1691] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:54 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:54.215647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:54.216243 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:54.221843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:54.222290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:54.223042 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:54.223474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:54.287670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:54.297220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ab59953a-67f7-449b-97dd-2d0cb5b06d74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085403 Jul 19 15:56:54.297787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 880/1692] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:55.227503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:55.228318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:55.234738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:55.235173 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:55.235929 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:55.236354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:55.364299 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:55.372140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7c0218d0-9cee-442d-8bd8-2bea32ca1f68 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148493 Jul 19 15:56:55.372693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 881/1693] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:55 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:55.377174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:55.377761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:55.383282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:55.383720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:55.384980 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:55.385484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:55.445080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:55.453499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3f7b3581-5139-487a-a6de-3a54537b24bc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079726 Jul 19 15:56:55.454081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 882/1694] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:56.389459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:56.390108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:56.396558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:56.396995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:56.397778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:56.398204 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:56.401327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:56.528802 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:56.536736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f296177d-72c7-433f-9754-4b4abf931c0e tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151400 Jul 19 15:56:56.537326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 883/1695] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:56 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:56.541888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:56.542473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:56.548177 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:56.548613 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:56.549400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:56.549827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:56.610412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:56.618256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ee774ad-75d5-4c4f-8067-62d4897cd736 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080005 Jul 19 15:56:56.619424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 884/1696] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:57.554390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:57.555045 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:57.562039 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:57.562483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:57.563238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:57.563694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:57.696263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:57.704271 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-43028917-a6df-42c3-8a88-d13f6c359eb4 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153856 Jul 19 15:56:57.704838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 885/1697] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:57 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:57.709174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:57.709777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:57.716330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:57.716775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:57.717560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:57.717992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:57.780786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:57.788594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2c26043e-8dea-403e-a9b1-c143cc755039 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082800 Jul 19 15:56:57.789175 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 886/1698] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:58.722657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:58.723262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:58.729823 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:58.730267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:58.731027 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:58.731458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:58.857768 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:58.865785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7a5ecc6e-48c8-4e75-ae3c-77761d2bdd14 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146967 Jul 19 15:56:58.866348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 887/1699] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:58 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:58.871970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:58.872572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:58.878283 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:58.878729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:58.879490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:58.879922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:58.940238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:58.948747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-24181b14-f7c7-4029-823c-f34ddc913ee9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081465 Jul 19 15:56:58.949340 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 888/1700] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:59.883653 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:59.884816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:59.891446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:59.891887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:59.892636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:59.893064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:00.027388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:00.035305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-de840a85-e867-4ec2-b8b7-b08825e875d3 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.155820 Jul 19 15:57:00.035875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 889/1701] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:59 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:00.040262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:00.041306 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:00.046909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:00.047351 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:00.048109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:00.048543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:00.109219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:00.117163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4dfd7985-f2b1-4df4-9344-6a8eb5792a62 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080315 Jul 19 15:57:00.117738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 890/1702] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:01.051837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:01.052499 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:01.054749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:01.060078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:01.060522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:01.061310 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:01.061746 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:01.189396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:01.197868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-83ab32b2-63fd-46de-a090-3616f11f0f71 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149897 Jul 19 15:57:01.198417 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 891/1703] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:01 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:01.202737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:01.203356 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:01.208850 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:01.209344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:01.210114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:01.210550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:01.425603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:01.434197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b42e3b2e-6350-4c64-b7ec-9dd55dfeb3ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.234844 Jul 19 15:57:01.434758 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 892/1704] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:02.215361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:02.216019 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:02.222442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:02.222881 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:02.223646 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:02.224072 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:02.352482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:02.360422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-817eae51-61d5-41c7-903f-98d833b9f5cb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149682 Jul 19 15:57:02.360966 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 893/1705] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:02 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:02.451462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:02.452056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:02.457908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:02.458345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:02.459121 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:02.459546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:02.519398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:02.527141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-75ce2a65-05ea-4d2b-b4fd-5dabe9ecd3e5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079465 Jul 19 15:57:02.527685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 894/1706] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:03.377382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:03.377997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:03.385133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:03.385603 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:03.386364 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:03.386797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:03.515988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:03.523811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-42c7ce9b-2343-4616-939b-9560c3171a59 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150310 Jul 19 15:57:03.524368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 895/1707] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:03 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:03.543806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:03.544402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:03.550053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:03.550498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:03.551256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:03.551689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:03.842775 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:03.850712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1bd922cd-09aa-42dc-ba3d-036de5ede109 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.310852 Jul 19 15:57:03.851267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 896/1708] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:04.539773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:04.540948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:04.547372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:04.547814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:04.548569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:04.548996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:04.674882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:04.682690 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6b16ed01-83e5-46a6-868e-00d8e65cc1e5 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146843 Jul 19 15:57:04.683252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 897/1709] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:04 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:04.867277 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:04.867814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:04.873673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:04.874110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:04.874870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:04.875307 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:04.935772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:04.943523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-62e431c0-c681-4293-8180-ab9c8644d71e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080000 Jul 19 15:57:04.944077 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 898/1710] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:05.699877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:05.700468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:05.706900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:05.707347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:05.708103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:05.708547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:05.835776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:05.838050 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:05.844988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f0d2ebf0-2d6d-4e54-91c6-a12f725c615b tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.149050 Jul 19 15:57:05.845576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 899/1711] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:05 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:05.960667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:05.961215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:05.967628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:05.968070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:05.968827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:05.969287 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:06.028132 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:06.035816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-30b2babd-46a8-4eaa-b961-edb94c2c74c1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.078883 Jul 19 15:57:06.036368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 900/1712] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:06.862862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:06.863689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:06.871143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:06.871710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:06.872479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:06.872907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:07.004381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:07.013624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-96f3fab6-daba-42c9-b259-e0f38b379fbb tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154390 Jul 19 15:57:07.014175 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 901/1713] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:06 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:07.053128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:07.053814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:07.060205 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:07.060643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:07.061428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:07.061864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:07.121796 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:07.129542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6af0c979-aff4-4748-a32a-50e1351f2e1a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080323 Jul 19 15:57:07.130092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 902/1714] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:08.031264 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:08.031970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:08.038304 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:08.038747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:08.039495 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:08.039923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:08.166695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:08.174540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-08f24cac-3d09-4b3c-a145-04837c9127c6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147190 Jul 19 15:57:08.175096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 903/1715] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:08 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:08.179417 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:08.180010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:08.186476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:08.186922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:08.187686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:08.188122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:08.250327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:08.258370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1655e017-18b1-4605-87c2-626f61eb9e94 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082320 Jul 19 15:57:08.258934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 904/1716] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:09.191869 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:09.192523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:09.199138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:09.199577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:09.200334 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:09.200763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:09.331848 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:09.340904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f8644147-2df8-4310-8013-bd4c26350639 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.152940 Jul 19 15:57:09.341491 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 905/1717] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:09 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:09.345902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:09.346494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:09.352195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:09.352640 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:09.353695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:09.354140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:09.415643 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:09.423585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f12f4376-0b61-4218-8199-10c5f1ee28d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081164 Jul 19 15:57:09.424140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 906/1718] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:10.358608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:10.359345 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:10.365809 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:10.366268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:10.367038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:10.367474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:10.498523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:10.506448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5cf8bceb-2497-4b06-8da1-4787a87546e6 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151762 Jul 19 15:57:10.506951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 907/1719] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:10 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:10.511268 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:10.511859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:10.517647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:10.518096 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:10.518860 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:10.519298 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:10.580114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:10.588626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-15fda403-64e8-452a-9331-93b7d6bc9e31 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080679 Jul 19 15:57:10.589203 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 908/1720] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:11.523686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:11.524336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:11.531200 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:11.531641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:11.532402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:11.532834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:11.661413 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:11.669875 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0c8c0be2-b58d-4228-80f1-983de221de6f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150078 Jul 19 15:57:11.670435 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 909/1721] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:11 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:11.676533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:11.677660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:11.686258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:11.686718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:11.687482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:11.687915 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:11.747266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:11.755114 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c38af860-1023-4271-ba24-bfa7e6f616e3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083740 Jul 19 15:57:11.755676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 910/1722] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:12.688593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:12.689305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:12.695736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:12.696179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:12.696944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:12.697455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:12.825778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:12.833583 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8ab8fb1c-8b6b-43e7-b5aa-edf2ac52f6cd tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.148862 Jul 19 15:57:12.834136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 911/1723] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:12 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:12.839071 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:12.839666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:12.845107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:12.845582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:12.846332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:12.846761 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:12.905994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:12.913715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-207f1b0f-cf44-4220-8f2d-8c3038b4421e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.078656 Jul 19 15:57:12.914266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 912/1724] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:13.850872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:13.851544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:13.858536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:13.858972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:13.859726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:13.860153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:13.992902 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:14.001541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4c2d3498-2857-4f0e-85f0-cbeb205ba5f1 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154518 Jul 19 15:57:14.002106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 913/1725] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:13 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:14.006444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:14.007046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:14.012684 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:14.013425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:14.014192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:14.014637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:14.075240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:14.083102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a0190fed-1b96-4004-adcc-2154484a3872 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080066 Jul 19 15:57:14.083655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 914/1726] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:14.560309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:57:14.560601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:57:15.019314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:15.019997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:15.026654 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:15.027092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:15.027842 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:15.028270 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:15.154489 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:15.162294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d89df1b5-c725-4f58-adbf-e51311227467 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.147178 Jul 19 15:57:15.162852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 915/1727] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:15 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:15.167736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:15.168330 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:15.173983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:15.174454 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:15.175234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:15.175692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:15.190354 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:15.236502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:15.245062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0ea3f1d0-b90a-40b3-9277-61322c900c18 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081240 Jul 19 15:57:15.245645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 916/1728] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:16.179624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:16.180284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:16.186622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:16.187066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:16.187818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:16.188246 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:16.328611 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:16.336470 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-60995fb7-5c24-4a06-a147-6730848e5393 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.160792 Jul 19 15:57:16.337024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 917/1729] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:16 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:16.342098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:16.342696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:16.348232 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:16.348676 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:16.349459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:16.349895 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:16.419669 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:16.428372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-28eb82ae-abea-41c7-b623-26e31d038012 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.089669 Jul 19 15:57:16.428944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 918/1730] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:17.355352 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:17.356029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:17.362440 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:17.362890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:17.363655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:17.364088 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:17.496154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:17.504068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-459eb198-630a-4926-81e6-718562b6143f tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153113 Jul 19 15:57:17.504555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 919/1731] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:17 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:17.508854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:17.509480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:17.515589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:17.516065 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:17.516822 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:17.517283 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:17.577133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:17.584951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e982edfb-531c-4901-9531-ea6898befbf7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079473 Jul 19 15:57:17.585529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 920/1732] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:18.521500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:18.522137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:18.528688 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:18.529124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:18.529908 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:18.530331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:18.656517 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:18.664339 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c456f820-df90-4d39-88bc-fc7dde1f65ae tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.146862 Jul 19 15:57:18.664891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 921/1733] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:18 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:18.669806 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:18.670398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:18.675893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:18.676335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:18.677086 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:18.677544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:18.738648 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:18.746592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-df6cedb2-038d-4267-b554-2f27e93bfa82 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080243 Jul 19 15:57:18.747149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 922/1734] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:19.682835 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:19.683488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:19.690324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:19.690837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:19.691719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:19.692219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:19.824943 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:19.832911 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6bb27936-ad64-4b3a-a675-dd0a86e07405 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.154869 Jul 19 15:57:19.833498 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 923/1735] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:19 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:19.837781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:19.838366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:19.844110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:19.844547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:19.845341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:19.845772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:19.905255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:19.913055 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0a093fda-b84c-4e9b-a13a-38fd7eb19866 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.078636 Jul 19 15:57:19.913641 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 924/1736] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:20.850133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:20.850795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:20.857190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:20.857637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:20.858389 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:20.858840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:20.988734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:20.997281 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cfb8f1a7-93b9-4b7d-94ac-7a27f069cd5a tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.151023 Jul 19 15:57:20.997830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 925/1737] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:20 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:21.002305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:21.002893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:21.008327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:21.008770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:21.010239 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:21.010666 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:21.069502 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:21.077958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3a44290d-15ff-40b4-9352-8c7fe6390405 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079174 Jul 19 15:57:21.078508 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 926/1738] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:22.013961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:22.014736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:22.021067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:22.021542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:22.022290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:22.022720 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:22.151920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:22.159810 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b101bcfa-4690-49bb-b44e-e57a7f80d900 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150017 Jul 19 15:57:22.160362 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 927/1739] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:22 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:22.164692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:22.165375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:22.171490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:22.171942 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:22.172699 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:22.173130 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:22.233460 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:22.241409 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20df9df9-6ffa-42bb-9f4a-929399ffd2b7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080076 Jul 19 15:57:22.241975 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 928/1740] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:23.179862 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:23.181573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:23.189221 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:23.189673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:23.190443 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:23.190873 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:23.370534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:23.378480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-72d39e76-9ca3-46c8-9023-513499cfe465 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.205331 Jul 19 15:57:23.379029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 929/1741] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:23 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:23.383419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:23.384070 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:23.390201 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:23.390642 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:23.391398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:23.391824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:23.452757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:23.460601 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b261ca07-dffa-4a5e-9828-9595ccdd05cb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080653 Jul 19 15:57:23.461172 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 930/1742] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:24.395145 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:24.395852 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:24.402790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:24.403231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:24.404013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:24.404465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:24.542706 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:24.550570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d617ce92-45e1-488e-97f1-ea8864b663da tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.159404 Jul 19 15:57:24.551125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 931/1743] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:24 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:24.555412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:24.556618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:24.562197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:24.562637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:24.563390 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:24.563825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:24.624233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:24.632004 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f44f9980-eebd-4366-b194-b35699cf5b49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079962 Jul 19 15:57:24.632560 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 932/1744] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:24 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:25.568294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:25.568941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:25.575958 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:25.576403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:25.577190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:25.577626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:25.581506 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:25.709997 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:25.717982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-80a725eb-ae79-4998-8d3b-89590315ed82 tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.153636 Jul 19 15:57:25.718593 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 933/1745] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:25 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:25.722952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:25.723543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:25.730366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:25.730819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:25.731614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:25.732078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:25.793447 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:25.801403 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0fba2f36-ff67-437a-9b03-2cb3ff181115 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081825 Jul 19 15:57:25.801962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 934/1746] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:26.735691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:26.736292 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] [instance: 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:26.742769 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:26.743276 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:26.744056 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:26.744485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:26.874523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746f7b2b60694c8a87a80f8801204345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1e0f23ca7114ecea8330a41af830c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:26.882474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5a5c31a5-1d9c-480c-8156-56bc8c8376fc tempest-VolumesSnapshotTestJSON-1184615858 tempest-VolumesSnapshotTestJSON-1184615858-project] 10.222.0.42 "GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc" status: 200 len: 1558 microversion: 2.1 time: 0.150647 Jul 19 15:57:26.883029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 935/1747] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:26 2022] GET /compute/v2.1/servers/74175f5a-2462-4fe9-9ad7-d6a5b60f62cc => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:26.888429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:26.889016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:26.894747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:26.895193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:26.895962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:26.896394 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:26.959262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:26.967991 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-cc75b395-c698-47bd-a065-17b1b482363a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083919 Jul 19 15:57:26.968565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 936/1748] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:27.984698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:27.985405 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:27.991755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:27.992202 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:27.992957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:27.993941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:28.055104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:28.063711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d25309a4-bb49-4b69-b11b-f08072555f55 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082916 Jul 19 15:57:28.064256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 937/1749] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:29.080909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:29.081617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:29.088257 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:29.088696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:29.089475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:29.089904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:29.153781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:29.161932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bb150fb7-1d0f-42a2-a80b-5db408dad73a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084855 Jul 19 15:57:29.162843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 938/1750] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:30.183046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:30.183741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:30.190344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:30.190786 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:30.191576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:30.192006 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:30.255106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:30.263382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a8fdd38b-1775-40c3-a263-f6ed3383adce tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087772 Jul 19 15:57:30.263933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 939/1751] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:31.280783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:31.281764 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:31.285116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=98 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:31.289386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:31.290467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:31.291325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:31.291763 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:31.350887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:31.359422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7497ede3-c3a6-40c2-ab54-698a8925f5db tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083170 Jul 19 15:57:31.359979 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 940/1752] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:32.377118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:32.377777 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:32.385367 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:32.385817 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:32.386576 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:32.387010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:32.449597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:32.457438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a965201a-735c-4706-b2a7-15578066dc74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084251 Jul 19 15:57:32.458010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 941/1753] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:33.475621 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:33.476267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:33.482735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:33.483174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:33.483930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:33.484360 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:33.547099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:33.554990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d6af007c-3730-4ad3-858f-013eef4846ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083308 Jul 19 15:57:33.555962 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 942/1754] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:34.572326 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:34.572963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:34.579526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:34.579970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:34.580728 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:34.581182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:34.642372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:34.650932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2a66c3b4-3fe3-49dc-82ce-1fd8c5d4ac41 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082617 Jul 19 15:57:34.651493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 943/1755] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:35.668503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:35.669473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:35.676474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:35.676913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:35.677698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:35.678129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:35.737770 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:35.746418 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-38a5093a-1b8a-4401-8af2-c8e0c568a032 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082510 Jul 19 15:57:35.746969 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 944/1756] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:36.764624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:36.765244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:36.771659 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:36.772098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:36.772847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:36.773305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:36.833792 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:36.841870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fd1f0433-d621-48e9-a44c-a66c47d4ff26 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081439 Jul 19 15:57:36.842422 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 945/1757] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:36 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:37.859188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:37.859865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:37.866227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:37.866668 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:37.867428 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:37.867948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:37.930814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:37.938816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-acd1ee80-a16c-4cc1-b08e-3a1c81dd31d1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083535 Jul 19 15:57:37.939369 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 946/1758] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:38.956214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:38.956818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:38.963976 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:38.964420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:38.965197 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:38.965628 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:39.028167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:39.036040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9602a0f5-cc14-41cc-8d23-f606b7486e45 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083777 Jul 19 15:57:39.036608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 947/1759] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:40.053724 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:40.054408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:40.061476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:40.061923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:40.062680 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:40.063111 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:40.123494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:40.131383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c9cfb111-2bfa-4e74-b96d-3e423abf28c6 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081542 Jul 19 15:57:40.131931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 948/1760] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:41.148386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:41.149057 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:41.156336 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:41.156772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:41.157573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:41.158010 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:41.223116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:41.225293 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:41.232378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9616b2cd-e607-4d2f-901b-56fc827d8d33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087813 Jul 19 15:57:41.232930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 949/1761] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:42.249538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:42.250220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:42.256712 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:42.257188 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:42.257949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:42.258375 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:42.320599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:42.329790 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ba28dbc4-e449-4f67-aa84-848f81d484d3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084056 Jul 19 15:57:42.330358 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 950/1762] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:43.347402 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:43.348012 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:43.354891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.355331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.356094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.356526 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.416719 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:43.424538 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-717971ea-ef07-45d0-b979-9ecfbc308c00 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081038 Jul 19 15:57:43.425109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 951/1763] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:44.442437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:44.443166 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:44.450025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:44.450473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:44.451236 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:44.451696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:44.515776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:44.523627 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f3c858a-7b56-44a9-831c-4102566a62ff tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085114 Jul 19 15:57:44.524179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 952/1764] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:45.541041 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:45.541721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:45.548149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.548600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.549397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.549834 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.609315 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:45.617453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a2a2076c-4028-4570-9fe0-b1b3a0a41abb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080479 Jul 19 15:57:45.618016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 953/1765] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:46.634888 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:46.635518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:46.642424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:46.642866 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:46.643631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:46.644067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:46.707731 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:46.716580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d9b9aa73-c448-4e7d-9e4c-14944561853c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086096 Jul 19 15:57:46.717133 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 954/1766] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:47.734032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:47.734634 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:47.741187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:47.741645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:47.742439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:47.742877 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:47.810231 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:47.818128 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-90df2811-261e-4292-b362-bb04eabe05e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087973 Jul 19 15:57:47.818694 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 955/1767] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:47 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:48.835024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:48.835656 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:48.842677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:48.843124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:48.843886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:48.844667 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:48.905745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:48.914481 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-21a8626b-9b0d-456b-bed7-437bff6adc5f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083270 Jul 19 15:57:48.915081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 956/1768] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:49.932008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:49.932698 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:49.939036 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:49.939478 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:49.940238 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:49.940673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:50.001102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:50.009571 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-da12d042-458c-498e-949e-5ea9befbd9e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081373 Jul 19 15:57:50.010134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 957/1769] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:51.025938 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:51.026570 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:51.032992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:51.033463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:51.034220 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:51.034657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:51.100670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:51.109097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-037def6e-eaba-4e08-8b37-5caa6e4aa672 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087105 Jul 19 15:57:51.109689 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 958/1770] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:52.127068 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:52.127800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:52.134824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:52.135272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:52.136037 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:52.136468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:52.197290 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:52.205208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-9529ea7f-40e7-4e6e-839f-45207c7f5bf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081996 Jul 19 15:57:52.205793 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 959/1771] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:53.222580 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:53.223319 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:53.229779 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:53.230228 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:53.230987 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:53.231419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:53.292948 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:53.301089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1b733f46-d22c-4c0c-b4d8-81dbc9de0830 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082333 Jul 19 15:57:53.302225 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 960/1772] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:54.318949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:54.319579 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:54.326482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:54.326927 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:54.327692 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:54.328122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:54.390926 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:54.398660 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0f6abda2-ea05-493c-891e-72d19af7cfb2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083667 Jul 19 15:57:54.399955 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 961/1773] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:55.416672 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:55.417344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:55.423924 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:55.424377 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:55.425148 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:55.425592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:55.488140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:55.496032 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4f693fce-cc85-4bdd-8084-f4ac80f4cad8 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083783 Jul 19 15:57:55.496592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 962/1774] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:56.513545 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:56.514187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:56.520637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:56.521080 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:56.521865 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:56.522300 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:56.582821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:56.590913 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6bcbf94c-ae2f-4536-91b0-8f518d47088d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082341 Jul 19 15:57:56.591471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 963/1775] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:57.609338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:57.609974 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:57.616291 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:57.616739 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:57.617529 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:57.618400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:57.678510 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:57.687471 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-517b8038-d575-4385-bedc-7f1e366774e2 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082064 Jul 19 15:57:57.688048 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 964/1776] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:58.705153 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:58.705795 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:58.712815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:58.713282 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:58.714338 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:58.714446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:58.774679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:58.782605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b3f573a0-650f-408f-935c-c233d46f33ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081397 Jul 19 15:57:58.783167 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 965/1777] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:58 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:57:59.803730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:59.804671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:59.811811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:59.812256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:59.813021 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:59.813494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:59.828040 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:59.876738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:59.884687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7ee41634-c26d-4309-9bb3-4c399d89dde4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087497 Jul 19 15:57:59.885329 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 966/1778] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:00.902038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:00.902635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:00.909025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:00.909500 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:00.910250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:00.910683 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:00.970704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:00.978578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1f7d7a0f-4375-43a7-9742-dd98fa3a8b2c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080685 Jul 19 15:58:00.979125 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 967/1779] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:01.994845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:01.995577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:01.997803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=56 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:02.003388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:02.003837 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:02.004608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:02.005047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:02.066578 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:02.075429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ee93bec4-9d86-4db7-8255-6864a545ce7b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084565 Jul 19 15:58:02.076263 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 968/1780] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:03.091890 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:03.092547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:03.098995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:03.099444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:03.100210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:03.100647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:03.162047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:03.169957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-24136961-31e0-48e3-98db-9a0582c2b9ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081950 Jul 19 15:58:03.170514 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 969/1781] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:04.186431 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:04.187115 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:04.193540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:04.193992 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:04.194762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:04.195208 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:04.260401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:04.268547 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-80782c58-5483-4d60-9c79-79f431be6cae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086021 Jul 19 15:58:04.269103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 970/1782] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:05.286108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:05.286725 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:05.293953 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:05.294393 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:05.295141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:05.295567 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:05.355608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:05.363474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e2c3adb8-668a-453a-8c98-e4b9a19a9765 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081215 Jul 19 15:58:05.364026 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 971/1783] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:06.379783 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:06.380444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:06.387717 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:06.388163 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:06.388923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:06.389383 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:06.448984 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:06.456843 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a6d0281a-871d-48da-815b-52845b030e47 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080954 Jul 19 15:58:06.457429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 972/1784] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:07.474363 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:07.475062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:07.482211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:07.482655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:07.483412 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:07.483916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:07.544637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:07.552426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-579cc130-7927-4892-960f-51d957aa71ba tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082046 Jul 19 15:58:07.552986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 973/1785] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:08.570146 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:08.571378 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:08.577604 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:08.578044 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:08.578800 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:08.579226 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:08.644451 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:08.653488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-470e456a-5c87-4b34-8be2-eda966a718d9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087229 Jul 19 15:58:08.654171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 974/1786] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:09.671134 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:09.671772 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:09.678295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:09.678748 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:09.679516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:09.680159 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:09.740230 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:09.748685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-186d1d55-0c73-4dc7-8b7b-c23079d7381d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081496 Jul 19 15:58:09.749254 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 975/1787] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:09 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:10.766193 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:10.766832 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:10.773436 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:10.773952 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:10.774553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:10.775095 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:10.834386 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:10.842849 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d59e730e-5bb4-4b4a-b56c-21a02ef238bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080746 Jul 19 15:58:10.843415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 976/1788] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:11.859559 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:11.860224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:11.866657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:11.868222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:11.868995 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:11.869458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:11.929914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:11.937624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-bfadb691-ae66-4c43-90dd-476d166fc6a9 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081996 Jul 19 15:58:11.938180 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 977/1789] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:12.954939 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:12.955595 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:12.962543 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:12.962982 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:12.963745 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:12.964177 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:13.026590 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:13.034520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-86d1c3d4-a380-4a83-acd3-8366255497c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083485 Jul 19 15:58:13.035083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 978/1790] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:14.051950 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:14.052607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:14.059670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:14.060118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:14.060891 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:14.061382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:14.121372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:14.129331 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fe058b34-b7a9-49fc-a057-7426b4aa51ad tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081341 Jul 19 15:58:14.129894 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 979/1791] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:15.146914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:15.147602 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:15.154110 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:15.154561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:15.155327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:15.155765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:15.215346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:15.223084 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-073ea5ad-042d-4dfe-9b0a-4975fce23eb0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080164 Jul 19 15:58:15.223649 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 980/1792] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:16.239311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:16.240016 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:16.246787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:16.247242 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:16.248026 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:16.248463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:16.309034 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:16.316914 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-2fc392ca-0433-48b4-bb64-a8ef48c47704 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081476 Jul 19 15:58:16.317524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 981/1793] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:17.334511 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:17.335136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:17.342342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:17.342787 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:17.343540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:17.343970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:17.408258 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:17.417573 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f109565e-96d5-4564-aabf-eba1d84baead tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086920 Jul 19 15:58:17.418129 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 982/1794] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:18.436099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:18.436825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:18.444426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:18.444998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:18.446141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:18.446589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:18.449313 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:18.511771 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:18.520051 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8e21424b-411f-459a-9973-32170e76c724 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.087862 Jul 19 15:58:18.520622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 983/1795] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:19.537797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:19.538464 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:19.545523 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:19.545964 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:19.546723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:19.547149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:19.607985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:19.615863 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-740a4212-8de8-4be6-bcea-62617b1f0e56 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082005 Jul 19 15:58:19.616426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 984/1796] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:20.631916 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:20.632657 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:20.639272 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:20.639722 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:20.640488 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:20.640923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:20.700655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:20.708533 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-dcc64649-59b0-40a3-a62a-3c111af85c09 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080627 Jul 19 15:58:20.709094 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 985/1797] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:20 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:21.725714 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:21.726473 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:21.732885 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:21.733372 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:21.734143 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:21.734582 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:21.798937 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:21.807532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7337eb4c-55ca-451b-ac90-2597352a1094 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085657 Jul 19 15:58:21.808097 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 986/1798] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:22.824821 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:22.825467 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:22.831934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:22.832381 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:22.833161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:22.833600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:22.895645 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:22.904555 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-96299c49-3e77-47a2-bf97-eded3921e007 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083627 Jul 19 15:58:22.905127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 987/1799] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:23.921618 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:23.922335 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:23.928620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:23.929122 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:23.930105 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:23.930540 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:23.989838 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:23.997765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-4aa32c3e-23cf-4f19-8ee8-18ac0961d4fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080092 Jul 19 15:58:23.998317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 988/1800] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:23 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:25.015171 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:25.015788 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:25.022187 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:25.023138 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:25.023904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:25.024337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:25.084858 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:25.093553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5ff26fec-b9de-4f5b-aaa4-d9700a22e080 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082584 Jul 19 15:58:25.094121 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 989/1801] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:25 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:26.110670 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:26.111366 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:26.118572 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:26.119013 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:26.119773 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:26.120195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:26.182874 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:26.190711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6154b7ac-66ab-4162-a69b-a25a53d2ac1f tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083924 Jul 19 15:58:26.191388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 990/1802] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:26 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:27.207631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:27.208266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:27.214824 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:27.215267 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:27.216033 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:27.216462 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:27.276457 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:27.284305 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d73a9c58-585c-4e91-ae2e-8d0d84a03197 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080645 Jul 19 15:58:27.284864 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 991/1803] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:27 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:58:28.301067 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:28.301743 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:28.308211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:28.308655 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:28.309474 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:28.309907 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:28.369592 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:28.377445 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-7bf25ba6-e722-4225-8ddb-fec55379de74 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080297 Jul 19 15:58:28.378008 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 992/1804] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:28 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:29.395785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:29.396426 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:29.403182 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:29.403629 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:29.404388 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:29.404826 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:29.464244 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:29.472174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b3dc06b1-6f96-4591-9b80-09a4b1befe14 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080251 Jul 19 15:58:29.472734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 993/1805] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:29 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:30.489735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:30.490459 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:30.497705 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:30.498164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:30.498905 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:30.499333 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:30.562018 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:30.569935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-15c7da1b-0742-4e23-a418-71976a345bdf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083914 Jul 19 15:58:30.570465 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 994/1806] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:30 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:31.586819 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:31.587468 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:31.593813 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:31.594255 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:31.595009 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:31.595433 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:31.656954 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:31.664851 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-fdbfd75f-5ed2-40ed-beab-09616aec9ebd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082085 Jul 19 15:58:31.665757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 995/1807] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:31 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:32.682637 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:32.683733 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:32.686160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=56 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:32.692083 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:32.692525 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:32.693414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:32.693859 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:32.757704 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:32.766961 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-888e92b1-bd7a-437d-b255-c6172f4e1926 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.088421 Jul 19 15:58:32.767521 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 996/1808] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:32 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:33.785117 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:33.785827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:33.792198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:33.792635 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:33.793417 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:33.793845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:33.854149 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:33.861986 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-55eb904b-92a7-4726-9162-ce30aca5ebc5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080752 Jul 19 15:58:33.862541 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 997/1809] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:33 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:34.879368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:34.880029 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:34.887289 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:34.887729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:34.888483 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:34.888909 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:34.952696 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:34.960485 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c0784ea5-b49e-47a3-8ef3-3adbcaf8b693 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.084993 Jul 19 15:58:34.961035 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 998/1810] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:34 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:35.978630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:35.979317 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:35.985797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:35.986240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:35.987001 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:35.987434 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:36.047144 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:36.049314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:36.056448 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6b308eb8-d25e-49be-9b39-d6c3d6d2aaf3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082052 Jul 19 15:58:36.057014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 999/1811] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:35 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:37.072812 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:37.073486 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:37.079804 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:37.080251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:37.081047 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:37.081504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:37.140994 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:37.148747 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6c31d14f-2d66-4c1e-8dde-9a7979c933b4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079996 Jul 19 15:58:37.149355 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1000/1812] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:37 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:38.165996 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:38.166686 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:38.173710 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:38.174161 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:38.174930 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:38.175368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:38.237119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:38.246099 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-8f464e88-3b5d-4814-b3a6-799cbf7e7a0b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083913 Jul 19 15:58:38.246674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1001/1813] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:38 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:39.263723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:39.264318 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:39.271251 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:39.271691 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:39.272444 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:39.272871 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:39.334605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:39.343503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-efaf6722-3361-4cfc-812d-cf252a5b51ab tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083889 Jul 19 15:58:39.344059 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1002/1814] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:39 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:40.361215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:40.361897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:40.368978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:40.369455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:40.370222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:40.370658 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:40.431677 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:40.439606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-6b77965b-c0db-4476-b966-6d58769df28d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082283 Jul 19 15:58:40.440162 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1003/1815] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:40 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:41.455707 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:41.456327 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:41.463294 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:41.463742 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:41.464515 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:41.464951 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:41.527025 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:41.534840 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-72f65d7a-b8ef-4075-8d6a-d4ff5c738d23 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082968 Jul 19 15:58:41.535397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1004/1816] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:41 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:42.552240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:42.552900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:42.559373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:42.559815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:42.560568 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:42.560999 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:42.620932 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:42.628729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f07017ed-da30-41ff-be22-8591af664530 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.080841 Jul 19 15:58:42.629324 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1005/1817] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:42 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:43.646941 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:43.647599 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:43.654614 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:43.655053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:43.655808 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:43.656237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:43.718469 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:43.726410 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-85f2d398-362d-4171-85fa-99892b17f9b3 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083455 Jul 19 15:58:43.726983 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1006/1818] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:43 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:44.744160 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:44.744798 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:44.751401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:44.751854 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:44.752624 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:44.753064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:44.813716 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:44.822240 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-0da3d915-1498-4c15-8af2-5add93e2b6bb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081420 Jul 19 15:58:44.822814 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1007/1819] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:44 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:45.839594 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:45.840219 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:45.846685 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:45.847136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:45.847903 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:45.848343 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:45.908024 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:45.916536 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-ee7c8081-3477-4fc2-ba20-f66b26ad4277 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081400 Jul 19 15:58:45.917103 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1008/1820] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:45 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:46.933633 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:46.934223 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:46.940752 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:46.941222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:46.941985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:46.942419 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:47.004106 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:47.012818 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-882eadff-b651-4797-a806-167179a1a5fb tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083793 Jul 19 15:58:47.013414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1009/1821] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:46 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:48.029789 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:48.030479 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:48.036897 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:48.037382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:48.038141 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:48.038577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:48.103493 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:48.111401 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5d870b78-1225-4d70-b042-dd4f199e6207 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085650 Jul 19 15:58:48.111957 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1010/1822] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:48 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:49.128794 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:49.129453 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:49.136109 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:49.136815 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:49.137620 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:49.138060 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:49.198693 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:49.206569 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a61c1679-0f1c-4005-a79e-2abf4d2b8cf4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081576 Jul 19 15:58:49.207137 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1011/1823] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:49 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:50.319630 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:50.320309 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:50.327147 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:50.327586 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:50.328337 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:50.328765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:50.389088 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:50.396887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-20c5f228-fef6-47cd-86be-be449feab59a tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.176986 Jul 19 15:58:50.397476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1012/1824] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:50 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:51.413736 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:51.414415 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:51.421262 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:51.421715 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:51.422482 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:51.422922 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:51.484399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:51.492487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-78a54d5d-20a1-43f8-b9a2-28013240392d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082634 Jul 19 15:58:51.493190 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1013/1825] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:51 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:52.509539 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:52.510587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:52.517524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:52.517971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:52.518741 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:52.519176 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:52.583589 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:52.592030 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-04a5c92d-c72c-459b-9111-6ddbba273918 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.086386 Jul 19 15:58:52.592584 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1014/1826] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:52 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:52.896382 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:58:52.896566 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:58:53.609311 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:53.609970 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:53.616295 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:53.616735 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:53.617513 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:53.617945 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:53.678531 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:53.686596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d5e8291b-5f2f-493d-95de-133ec7f1f4ae tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081162 Jul 19 15:58:53.687174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1015/1827] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:53 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:54.703923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:54.704617 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:54.710920 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:54.711368 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:54.712124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:54.712558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:54.727797 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:54.773522 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:54.782062 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a140afdf-0073-4bbc-9a30-100de4b97d9c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082316 Jul 19 15:58:54.782626 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1016/1828] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:54 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:55.799215 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:55.799893 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:55.806194 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:55.807636 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:55.808098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:55.808528 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:55.870038 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:55.877882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-96923c86-e4a4-4dc9-b713-1a2cde416b2d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082525 Jul 19 15:58:55.878437 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1017/1829] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:55 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:56.894414 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:56.895028 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:56.901519 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:56.901972 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:56.902737 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:56.903175 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:56.965064 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:56.972906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-a54b1929-6597-47a9-b094-fbd91667f67e tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082399 Jul 19 15:58:56.973494 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1018/1830] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:56 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:57.989867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:57.990544 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:57.997463 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:57.997917 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:57.998687 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:57.999124 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:58.060108 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:58.067985 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3154ef65-2810-4135-a185-e4853f2a9dc0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082030 Jul 19 15:58:58.068542 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1019/1831] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:57 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:58:59.087164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:58:59.088140 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:58:59.094179 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:59.094625 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:59.095391 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:58:59.095825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:58:59.156446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:58:59.164344 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-138d1ec6-2833-4715-9d8b-7ef23a99f741 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082610 Jul 19 15:58:59.164906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1020/1832] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:58:59 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:00.181296 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:00.182011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:00.188297 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:00.188734 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:00.189512 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:00.189944 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:00.250524 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:00.258458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-26ce6739-7eb4-44aa-a879-d0a3d3ab5eb7 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081133 Jul 19 15:59:00.259014 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1021/1833] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:00 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:01.275781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:01.276408 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:01.283429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:01.283934 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:01.284682 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:01.285116 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:01.350853 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:01.360022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-496c3059-359a-46d3-a1cc-626d38eb5e95 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.088111 Jul 19 15:59:01.360577 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1022/1834] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:01 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:02.377554 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:02.378212 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:02.385475 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:02.385936 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:02.386933 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:02.387361 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:02.448723 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:02.456487 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f8bfc2c7-3c9d-4e00-9351-883a31cede33 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082933 Jul 19 15:59:02.457046 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1023/1835] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:02 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:03.473456 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:03.474151 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:03.476325 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=56 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:59:03.481530 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:03.481971 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:03.482729 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:03.483158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:03.544073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:03.551867 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b9eae150-ea4c-4df5-82bd-8fce803fc85d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082546 Jul 19 15:59:03.552424 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1024/1836] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:03 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:04.569399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:04.570053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:04.576504 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:04.576947 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:04.577730 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:04.578158 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:04.638727 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:04.646553 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1dd70368-3177-4db9-8728-9517ecb54524 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081128 Jul 19 15:59:04.647107 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1025/1837] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:04 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:05.664695 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:05.665870 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:05.673480 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:05.673931 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:05.674701 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:05.675136 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:05.742749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:05.751429 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-33ff5e0e-6343-431b-ad3f-54ab814dea8c tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.090709 Jul 19 15:59:05.751993 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1026/1838] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:05 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:06.769278 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:06.769878 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:06.776671 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:06.777112 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:06.777887 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:06.778346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:06.836963 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:06.844965 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-5cebdad2-a544-497a-87b7-2efb8b3178ca tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079543 Jul 19 15:59:06.845558 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1027/1839] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:06 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:07.862674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:07.863341 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:07.869825 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:07.870266 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:07.871022 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:07.871449 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:07.930681 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:07.938622 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-c008c494-6f1a-4139-a71e-d635dfc84e28 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.079830 Jul 19 15:59:07.939195 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1028/1840] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:07 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:08.956373 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:08.956973 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:08.964102 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:08.964550 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:08.965347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:08.965791 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:09.025803 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:09.033606 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-85475a0d-1b74-456c-bcb7-1990942f0dd1 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081228 Jul 19 15:59:09.034168 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1029/1841] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:08 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:10.051332 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:10.052503 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:10.059647 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:10.060089 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:10.060847 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:10.061399 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:10.123256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:10.131210 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-07119074-a1c6-4f6e-a159-98eacf8b23c4 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083805 Jul 19 15:59:10.132079 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1030/1842] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:10 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:11.147785 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:11.148518 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:11.155284 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:11.155721 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:11.156476 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:11.156904 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:11.218314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:11.226174 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-91574253-be71-48fe-acec-967eb134c7fc tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082262 Jul 19 15:59:11.226738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1031/1843] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:11 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:12.244516 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:12.245224 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:12.251988 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:12.252585 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:12.253398 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:12.254053 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:12.315073 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:12.323371 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-e9803bdb-cd79-4e82-a604-cf37a90b6f9d tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083432 Jul 19 15:59:12.323923 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1032/1844] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:12 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:13.340127 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:13.340811 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:13.347234 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:13.347679 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:13.348439 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:13.348872 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:13.352744 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=100 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:59:13.410139 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:13.417900 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-204b5ab9-1400-4fe2-b960-c4d1f8a5fb49 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081919 Jul 19 15:59:13.418455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1033/1845] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:13 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:14.434868 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:14.435534 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:14.442600 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:14.443049 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:14.443816 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:14.444250 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:14.508066 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:14.516441 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-1a9346da-4053-44e0-a56c-9e6524892d51 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.085623 Jul 19 15:59:14.516998 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1034/1846] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:14 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:15.533000 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:15.533765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:15.540118 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:15.540605 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:15.541396 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:15.541830 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:15.602766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:15.610665 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f1d20217-e155-46a3-a3b7-993c31d458a5 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081610 Jul 19 15:59:15.611227 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1035/1847] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:15 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:16.173192 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:59:16.173427 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 15:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:59:16.627846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:16.628527 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:16.635259 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:16.635702 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:16.636709 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:16.637157 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:16.699249 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:16.706990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-75743413-ca6f-406a-b618-17972f48d47b tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083069 Jul 19 15:59:16.707532 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1036/1848] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:16 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:17.723886 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:17.724546 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:17.731949 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:17.732425 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:17.733211 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:17.733651 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:17.794507 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:17.802349 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b98b85b8-b3d2-44ba-86f2-92fc135ad0dd tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.082342 Jul 19 15:59:17.802906 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1037/1849] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:17 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:18.819749 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:18.820346 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:18.827565 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:18.828005 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:18.828762 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:18.829222 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:18.891673 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:18.900092 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-3183e2e8-5147-4eb7-851a-8b39acd60c63 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083987 Jul 19 15:59:18.901104 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1038/1850] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:18 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:19.922342 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:19.923011 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:19.929711 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:19.930156 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:19.931509 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:19.932597 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:20.003432 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:20.013990 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-78bca9da-14fb-4884-962c-3269b76f10d0 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.095187 Jul 19 15:59:20.014587 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1039/1851] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:19 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:21.031726 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:21.032370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:21.038766 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:21.039214 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:21.041164 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:21.041609 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:21.100442 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:21.108846 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-d13b3f4b-d3f4-450a-8f7a-db3d7eb55c42 tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.081048 Jul 19 15:59:21.109438 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1040/1852] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:21 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:59:22.125020 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:22.125740 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.compute.api [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] [instance: 3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf] Fetching instance by UUID {{(pid=118007) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:59:22.132314 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:22.132765 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:22.133561 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:59:22.134003 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:59:22.196596 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.policy [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15af8262a49946739a79f12ec7f8b15d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05857a00bdb14c54800b5e0f55ed27fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118007) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:59:22.204420 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-b5e8f9b4-728d-4319-b271-7276c24a44bf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf" status: 200 len: 1390 microversion: 2.1 time: 0.083255 Jul 19 15:59:22.204978 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1041/1853] 10.222.0.42 () {58 vars in 1235 bytes} [Tue Jul 19 15:59:22 2022] GET /compute/v2.1/servers/3f35b87e-4ba4-4e0d-94ba-23cb171d2ecf => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:59:22.219827 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-eb1bea66-fdc1-46b2-8292-f4785ec4cecf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] Calling method '.version_select at 0x7f832375ab80>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:59:22.240196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-eb1bea66-fdc1-46b2-8292-f4785ec4cecf tempest-TestMinimumBasicScenario-1598806601 tempest-TestMinimumBasicScenario-1598806601-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2123048029" status: 202 len: 0 microversion: 2.1 time: 0.023708 Jul 19 15:59:22.240757 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1042/1854] 10.222.0.42 () {58 vars in 1271 bytes} [Tue Jul 19 15:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2123048029 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:59:40.312678 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell1:SELECT=53 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:59:40.313455 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:59:40.486256 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-90d7b5b2-6aef-4135-a2d6-abb2db729ecb tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] Action: 'create', calling method: .version_select at 0x7f8323474670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1524717733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUbbYymVeLiiWHX2o5WxWlF6G4lyGIy6fvN/VYMLyaWBciTIuR/aua2ZdYCNxwP99nyhRxjPd/bdtKIDQ7ENWOUdD+4+u0oFQCWQpBufEOrmdsZ+q4dX3ReT4wqa6hXIg=="}} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:59:40.500198 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-90d7b5b2-6aef-4135-a2d6-abb2db729ecb tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] Getting quotas for project ae073bb1e3214abaabdf711901bfa192. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:59:40.504081 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.quota [None req-90d7b5b2-6aef-4135-a2d6-abb2db729ecb tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] Getting quotas for user f1d44fdb8f544694919f673949a9f182 and project ae073bb1e3214abaabdf711901bfa192. Resources: {'key_pairs'} {{(pid=118007) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:59:40.527154 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-90d7b5b2-6aef-4135-a2d6-abb2db729ecb tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.215891 Jul 19 15:59:40.527738 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1043/1855] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Jul 19 15:59:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 16:00:41.716484 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_cell0:SELECT=4 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 16:00:41.717631 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 16:00:41.722674 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [None req-f0bd2873-9147-4e81-a5ac-4597e9823ae1 tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] Calling method '.version_select at 0x7f83281be670>' {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 16:00:41.742776 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [None req-f0bd2873-9147-4e81-a5ac-4597e9823ae1 tempest-TestVolumeBootPattern-462538385 tempest-TestVolumeBootPattern-462538385-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1524717733" status: 202 len: 0 microversion: 2.1 time: 0.028640 Jul 19 16:00:41.743348 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1044/1856] 10.222.0.42 () {58 vars in 1262 bytes} [Tue Jul 19 16:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1524717733 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 16:01:24.594778 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG dbcounter [-] [118007] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=118007) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 16:01:24.787098 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG nova.api.openstack.wsgi [req-a2672dcf-ea37-49a7-aa72-3a4712d61ba0 req-c5a6d08e-2ab7-434a-a610-a5ffc4ca738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74175f5a-2462-4fe9-9ad7-d6a5b60f62cc", "name": "network-vif-deleted", "tag": "0a49ec3b-6974-4be8-ae96-68813b154d1a"}]} {{(pid=118007) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 16:01:24.796935 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-a2672dcf-ea37-49a7-aa72-3a4712d61ba0 req-c5a6d08e-2ab7-434a-a610-a5ffc4ca738d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 16:01:24.797397 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: DEBUG oslo_concurrency.lockutils [req-a2672dcf-ea37-49a7-aa72-3a4712d61ba0 req-c5a6d08e-2ab7-434a-a610-a5ffc4ca738d service nova] Lock "8b38ae4e-b1b5-4270-b09a-0bd9af4d5d38" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118007) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 16:01:24.808370 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.compute.server_external_events [req-a2672dcf-ea37-49a7-aa72-3a4712d61ba0 req-c5a6d08e-2ab7-434a-a610-a5ffc4ca738d service nova] Creating event network-vif-deleted:0a49ec3b-6974-4be8-ae96-68813b154d1a for instance 74175f5a-2462-4fe9-9ad7-d6a5b60f62cc on hv-cinder-84984 Jul 19 16:01:24.814882 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO nova.api.openstack.requestlog [req-a2672dcf-ea37-49a7-aa72-3a4712d61ba0 req-c5a6d08e-2ab7-434a-a610-a5ffc4ca738d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221608 Jul 19 16:01:24.815520 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: [pid: 118007|app: 0|req: 1045/1857] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Jul 19 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 16:02:12.904581 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:02:12.905196 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:02:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:03:54.572275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:03:54.573275 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:03:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:04:16.183347 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 19 16:04:16.184078 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:04:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:05:32.912608 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:05:32.913385 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:07:14.580075 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:07:14.580755 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:07:36.193017 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:07:36.193781 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:08:52.921400 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:08:52.922119 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:10:34.588379 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:10:34.589252 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:10:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:10:56.200446 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:10:56.201233 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:10:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:12:12.929718 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:12:12.930490 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:13:54.596662 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:13:54.597458 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:14:16.209237 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:14:16.209940 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:15:32.938845 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:15:32.939607 dv-cinder-849846-2-iscsi devstack@n-api.service[118007]: Tue Jul 19 16:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!